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PREFACE 

Although  the  Health  Standards  and  Quality  Bureau  (HSQB)  had  previously 
funded  several  special  projects  in  ambulatory  care  quality  assurance, 
the  Bureau  initiated  a  systematic  investigation  of  formal  ambulatory 
care  review  programs  in  1975.    Findings  of  this  investigation*  highlighted 
the  need  for  careful  examination  of  alternative  ambulatory  care  review 
approaches  to  determine  their  feasibility,  especially  in  the  PSRO 
environment. 

In  1976,  under  the  guidance  of  Michael  Goran,  M.D.,  former  Director, 
HSQB,  a  demonstration  program  was  initiated  to  further  examine  ambulatory 
care  review  methods  within  Professional  Standards  Review  Organizations. 

On  July  1,  1976  a  letter  from  HSQB  was  sent  to  all  the  PSROs  invit- 
ing them  to  participate  in  an  ambulatory  care  review  demonstration  pro- 
ject.   These  letters  specified  that  "the  demonstrations  will  be  designed 
to  assess  various  approaches  to  ambulatory  care  quality  assurance  in  a 
variety  of  health  service  delivery  systems  with  substantial  variety  in 
the  method  of  obtaining  a  rational  PSRO  coordination  approach  for  each 
project."    Five  demonstration  projects  were  selected  to  participate  in 
the  demonstration  project.    Representing  a  variety  of  locations  and 
proposed  methods  the  five  projects  began  formal  planning  activities  in 
early  October  1976.    The  demonstration  projects  are  Central  Massachusetts 
PSRO,  Bronx  PSRO,  Southcentral  Pennsylvania  PSRO,  Multnomah  Foundation 
for  Medical  Care,  and  New  Mexico  PSRO. 

At  the  same  time  as  the  demonstration  projects  were  being  selected 
an  analysis  contractor  was  selected  to  "assist  PSRO  in  developing  the 
demonstration  protocols  and  be  responsible  for  assessment  and  analysis 

♦Contract  No.  240-75-0101,  Bureau  of  Quality  Assurance,  Health  Services 
Administration 

iii 


of  the  effectiveness  of  each  of  the  demonstration  projects  in  conjunction 
with  the  PSROs."    Health  Care  Management  Systems,  Inc.  (HCMS)  has  performed 
as  the  ambulatory  demonstration  analysis  contractor  since  July,  1976. 
HCMS  was  also  involved  in  a  three-year  grant  program  funded  by  The 
Robert  Wood  Johnson  Foundation  to  examine  ambulatory  quality  assurance 
programs  with  special  emphasis  on  information  systems.    Some  funding 
provided  by  the  Foundation  grant  was  used  to  give  a  private  perspective 
to  the  government-funded  demonstration  project  and  to  synthesize  results 
of  the  project  with  other  ambulatory  care  quality  assurance  research  and 
evaluation  programs  in  which  HCMS  was  engaged. 

This  report  on  the  development  of  ambulatory  care  review  methods  in 
the  five  PSROs  demonstration  projects  is  in  partial  fulfillment  of  the 
analysis  contract  requirements.    The  report  includes  two  volumes  and 
two  appendices: 

Program  Overview  and  Discussion 
Bronx  PSRO 

Central  Massachusetts  PSRO 
Multnomah  Foundation  for  Medical  Care 
New  Mexico  PSRO 

Southcentral  Pennsylvania  PSRO 
Policy  Recommendations  and  Technical  Guidelines 
Interim  Report  -  Cooperative  Demonstration  and  Analysis 
of  Ambulatory  Care  Quality  Assurance  Review  Methodology 
in  PSRO  Settings  -  November  1977 

Ambulatory  Medical  Care  Quality  Assurance  1977  Conference 
Proceedings,  La  Jolla  Health  Science  Publications,  La 
Jolla,  California  1977 


Volume  I 
Section  1 
2 
3 
4 
5 

Volume  II 
Appendix  1 


Appendix 
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Project  overviews  and  data  for  each  of  the  demonstration  projects 
are  documented  in  Volume  I.    This  volume  is  especially  useful  as  examples 
of  ambulatory  care  review  developmental  efforts  in  PSRO.    Volume  II, 
"Policy  Documentation  and  Technical  Guidelines"  are  directed  to  HSQB  and  other 
agencies  involved  in  medical  care  quality  assurance  and  utilization 
review  in  a  regulatory  environment.    The  appendices  include  the  Interim 
Report  which  describes  the  first  year  demonstration  project  activity 
and  findings.    The  second  appendix  is  a  book  containing  papers  presented 
at  a  two-day  national  conference  on  ambulatory  care  quality  assurance. 
The  entire  report  is  designed  to  assist  organizations  searching  for 
feasible  ambulatory  care  review  alternatives. 
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INTRODUCTION  AND  PURPOSE 
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Assessment  activities  conducted  in  each  of  the  five  Professional 
Standards  Review  Organization  (PSRO)  ambulatory  review  projects  were 
concentrated  in  several  areas:    a)  description  of  project  administration, 

b)  description  of  activities  in  the  areas  of  planning  and  administration, 
topic  selection,  criteria  development,  data  collection,  data  processing, 
review  and  decision  making,  feedback  and  intervention,  and  restudy,  and 

c)  description  of  resources  expended  to  accomplish  the  project's  goals. 

The  general  objectives  of  this  final  report  are  to: 

1.  Summarize  the  PSRO  activity  by  presenting  a  variety  of 
descriptive  documentation  (Volume  I). 

2.  Document  findings  of  investigation  of  review  techniques 
employed  by  each  PSRO  (Volume  I). 

3.  Guide  future  technical  assistance  conducted  by  HSQB 
(Volume  II). 

4.  Provide  recommendations  regarding  implementation  of  ambu- 
latory care  review  systems  by  current  and  future  PSRO 
demonstration  projects  (Volume  II). 

Presented  in  this  volume  first  is  a  brief  program  overview  designed 
to  acquaint  the  reader  with  each  PSRO  project.    If  more  in-depth  informa- 
tion is  desired,  either  the  site  itself  or  HCMS  can  provide  a  more 
detailed  description.    The  next  three  sections  describe  activities  that 
occurred  at  each  project  and  the  results  of  these  activities.  Finally, 
the  last  section  presents  resource  data  for  each  PSRO  site. 

Of  the  five  PSROs  funded  in  the  demonstration  program,  four  are 
initiating  ambulatory  care  review  systems  where  no  prior  system  existed. 
They  are:    Central  Massachusetts  PSRO,  Bronx  PSRO,  Southcentral  Pennsylvan 


PSRO,  and  Multnomah  Foundation  for  Medical  Care.    The  fifth  demonstration 
program,  New  Mexico  PSRO,  has  operated  a  claim-based  review  system  for 
several  years  under  contract  with  the  State  Medicaid  agency.    The  New 
Mexico  PSRO  demonstration  has  explored  some  specific  review  questions, 
most  of  which  were  research  oriented. 

HCMS  data  collection  for  this  report  has  continued  since  the 
beginning  of  the  demonstration  project.    Each  project  has  cooperated 
in  providing  many  different  types  of  data  including  questionnaire 
information,  counts  of  activities,  computer  run  sheets,  personnel  hourly 
activity  description,  minutes  of  meetings,  and  written  project  reports. 
The  cut-off  date  for  data  was  August  31,  1978,  except  for  resource 
data  which  was  discontinued  on  June  30,  1978.    Therefore,  the  most 
recent  activities  of  each  project  are  not  reflected  in  this  report. 
The  reader  should  be  aware  that  this  report  does  not  attempt  to 
describe  the  entire  data  base  of  each  project;  the  activities  and 
data  described  are  meant  to  be  representative  of  the  operations  of 
each  demonstration  project. 
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PROGRAM  OVERVIEW 
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PROJECT  PARTICIPANTS 
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James  Z.  Appel ,  M.D.,  President,  SCPPSRO 
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Herbert  L.  Tindall,  M.D.,  AMCRO  Physician  Codirector 
David  J.  Jones,  M.D. 

II      Staff  Participants 

Nikki  Chamberlin,  Project  Manager,  Product  Development  Department, 

Pennsylvania  Blue  Shield 
Harold  Diehl,  Jr.,  F.A.C.H.A. ,  Executive  Director,  SCPPSRO 
Ann  K.  Shearer,  A.R.T.,  Audit  Coordinator,  SCPPSRO 
Alex  Mitchell,  Director,  Research  Department,  Pennsylvanie  Blue 
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PREFACE 

Southcentral  Pennsylvania  PSRO  (SCPPSRO)  was  awarded  a  contract 
by  the  Health  Standards  and  Quality  Bureau  (HSQB)  to  implement  an 
ambulatory  review  program  over  a  two-year  period.    The  initial  contract 
was  extended  for  9  months.    SCPPSRO  was  required  to  implement  office 
audits  in  a  number  of  group  practices  and  to  conduct  research  comparing 
data  and  review  results  of  the  office  audits  with  Medicare  Part  B 
claims  data.    The  project's  broad  objective  was  to  test  and  implement 
a  review  capability  which  uses  Medicare  claims  review  as  a  screening 
device  for  identifying  physicians  or  cases  requiring  more  in-depth 
office  audit. 

SCPPSRO  enlisted  the  participation  of  109  physicians  in  ten  ambu- 
latory care  settings  (seven  small  family  practices,  three  hospital 
based  practices)  and  obtained  the  cooperation  of  the  Medicare  carrier, 
Pennsylvania  Blue  Shield  (PBS).    The  office  audit  was  conducted  indepen- 
dently of  Blue  Shield's  development  and  review  of  claim  files  for 
each  participating  practice  with  the  objective  of  subsequently  matching 
patients  and  physicians  from  the  claim  and  office  review.  SCPPSRO 
negotiated  a  contract  with  PBS  to  process  the  office  data  and  complete 
the  comparison  of  claim  and  office  audit  results. 

SCPPSRO  developed  two  planning  documents  during  a  four-month 
period  at  the  beginning  of  the  project  after  HSQB  approval  of  the 
initial  concept  paper. 
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PROJECT  ADMINISTRATION 

The  SCPPSRO  Board  of  Directors  maintains  overall  responsibility  for 
the  demonstration  program.    Figure  1  is  an  organizational  chart  which 
depicts  the  functional  relationships  between  the  PSRO  Board  of  Directors 
and  the  numerous  organizational  units  of  the  project. 

In  the  early  planning  stages  of  the  project,  the  Ambulatory  Care 
Review  Operations  (AMCRO)  Task  Force  was  formed  which  consisted  of  the 
following  representatives: 

1.  PSRO  President  and  Ambulatory  Demonstration  Project 
Director 

2.  PSRO  Executive  Director 

3.  Two  supervising  physicians  for  the  office  audit 

4.  Vice  President  of  PBS 

5.  Project  Manager  of  Research,  PBS 

The  AMCRO  Task  Force  was  the  primary  administrative  and  organizational 
unit  and  implemented  the  ambulatory  care  review  system,  including  perform- 
ance of  the  following  tasks: 

1.  Development  of  the  demonstration  plan 

2.  Approval  of  all  criteria 

3.  Development  of  the  integration  format  (the  data  base,  critical 
elements,  and  decision-making  format) 

4.  Development  of  a  case  identification  and  data  collection 
procedure 

5.  Coordination  and  integration  of  office  and  claim  based  data 

6.  Development  of  review  results 

The  Southcentral  Pennsylvania  PSRO  Board  of  Directors  and  Executive 
Committee  preside  over  the  AMCRO  Task  Force. 
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FIGURE  1 
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After  formation  of  the  AMCRO  Task  Force,  a  management  plan  was 
developed  which  divided  the  project  into  two  major  elements  under 
separate  co-directors.    The  Group  A  segment  refers  to  activities  and 
personnel  involved  in  the  PSRO  office  audit  portion  of  the  study  while 
the  Group  B  segment  refers  to  the  Blue  Shield  claim  matching  and  inter- 
face activities  as  well  as  data  processing. 

The  office  audit  is  managed  by  two  physician  members  of  the  Task 
Force  (Group  A  Co-directors).    Their  responsibilities  include: 

1.  Development  of  critical  criteria  and  elements  of  care  for  each 
topic 

2.  Design  of  the  format  for  data  collection 

3.  Specification  of  data  displays 

4.  Review  and  analysis  of  data 

5.  Design  of  feedback  study  practices 

Claim  screening  and  integration  is  managed  by  the  Medicare  carrier 
representative  to  the  project  (Group  B  Co-director)  who  is  primarily 
responsible  for  delineating  data  requirements  and  data  collection  efforts 
and  overseeing  all  activities  related  to  screening  functions  performed 
by  Blue  Shield. 

The  PSRO  employed  a  review  coordinator  who  was  responsible  for  the 
daily  management  of  the  project.    This  person  worked  closely  with  physi- 
cian supervisors  and  PBS  personnel  and  was  responsible  for  training  and 
managing  the  abstractors  who  collected  office  data. 

At  each  practice  site,  one  abstractor  was  responsible  for  all  data 
collection.    The  abstractors  reported  directly  to  the  review  coordinator 
who  also  worked  with  practice  personnel  in  collecting  information. 
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While  task  force  members  and  staff  reported  to  the  project  director 
the  management  of  the  project  was  characterized  by  frequent  interaction 
among  project  staff,  with  informal  reporting  guidelines.    The  Group  A 
co-directors  were  the  primary  interface  between  the  PSRO  and  the  parti ci 
pating  practices.    Each  practice  had  an  appointed  representative  to  work 
with  PSRO  staff  on  review  activities. 

The  HSQB  analysis  contractor  acted  as  an  ongoing  consultant  to  the 
project.    Other  advisory  groups  and  consultants  included  a  project 
design  specialist,  a  computer  systems  analyst,  a  biostatistical  consul- 
tant, and  the  Pennsylvania  Medical  Care  Foundation. 

The  SCPPSRO  Executive  Director  was  responsible  for  monitoring  the 
project's  fiscal  affairs  and  for  overall  coordination  of  administrative 
matters. 

TECHNICAL  COMPONENTS 

A.     Selection  of  Topics  for  Review 

The  Group  A  co-directors,  who  had  been  active  in  ambulatory  review 
in  the  PSRO  area  for  several  years,  supervised  the  topic  selection  pro- 
cess.   The  co-directors  selected  eight  review  topics  based  on  frequency 
data  from  two  large  family  practices  whose  general  utilization  patterns 
were  felt  to  reflect  those  of  other  family  practices  in  the  area.  The 
topics  chosen  included  preventive  care  (adult),  arthritis,  chest  pain, 
urinary  tract  infection,  anxiety  and  depression,  chronic  ischemic  heart 
disease,  hypertension  and  diabetes  mellitus.    The  Task  Force  reviewed 
the  topics  and  frequency  data,  and  approved  the  initiation  of  criteria 
development  for  the  selected  topics.    The  project  was  not  designed  to 
determine  whether  problems  existed  in  treatment  of  the  topics  prior  to 
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their  selection,  but  it  was  felt  that  high  frequency  was  an  adequate 
criterion  on  which  to  base  topic  selection. 

Blue  Shield  staff  gathered  claim  review  data  on  the  same  topics 
that  were  audited  in  the  office  practices,  with  the  exception  of  two 
topics  for  which  Blue  Shield  could  not  gather  data  (preventive  care  - 
adult,  and  anxiety  and  depression). 

In  addition  to  topic  selection,  a  number  of  factors  required  con- 
sideration in  the  selection  of  sites  and  providers  for  review.  The 
criteria  for  selection  of  the  ten  participating  sites  clearly  reflect 
the  voluntary  nature  of  the  project: 

1.  Demonstrated  interested  in  ambulatory  care  review 

2.  Recognized  competence  in  providing  ambulatory  care 

3.  Location  within  Dauphin  and  Lancaster  Counties 

4.  Willingness  to  participate  in  project  activities 

There  was  also  an  attempt  to  obtain  some  diversity  in  practice  styles, 
record  keeping  systems  and  practice  size.    The  ten  practices  furnished 
estimates  of  the  total  number  of  patient  visits  in  an  eight-month  period. 
Then,  using  available  diagnosis-specific  data,  estimates  of  frequency  of 
visits  for  the  eight  review  topics  were  made  for  all  of  the  practices. 
Each  office  designated  both  an  administrative  and  a  medical  person  to  be 
responsible  for  relating  to  the  PSRO  regarding  project  activities. 

B.     Criteria  Development 

Some  of  the  criteria  sets  used  for  the  project  were  adapted  from 
existing  criteria  being  used  to  review  ambulatory  services  at  Hers  hey 
Medical  Center  and  in  the  outpatient  department  of  Lancaster  General 
Hospital.    The  remainder  of  the  criteria  sets  were  developed  by  the 
AMCRO  Task  Force.    Participating  practice  sites  had  the  opportunity  to 
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review  and  comment  on  the  critical  criteria.    Final  review  revision  and 
approval  of  all  critical  criteria  and  elements  of  care  was  the  respon- 
sibility of  the  Norms,  Criteria  and  Standards  Committee  of  PSRO. 

Each  criteria  set  included  an  extensive  list  of  medical  procedures 
for  each  diagnostic  topic  and  a  subset  of  critical  criteria  for  use  in 
the  analysis  and  review  (see  Appendix  A:    SCPPSRO  Critical  Criteria  and 
Ambulatory  Care  Data  Base).    The  critical  criteria  included  between  4 
and  8  processes  and  other  indicators  per  topic.    These  items  were  con- 
sidered by  the  PSRO  to  have  a  major  impact  on  the  quality  of  care,  and 
to  a  lesser  extent,  on  the  cost  of  services  provided.    The  elements  of 
care  included  processes  and  procedures  commonly  used  in  office  based 
practice  for  the  care  of  the  particular  diagnosis  and  also  encompassed 
demographic  data,  diagnoses,  laboratory  data,  medications,  referral 
status,  and  clinical  values. 

Each  set  of  critical  criteria  contained  at  least  one  potential 
outcome  measurement.    One  subobjective  of  the  review  was  to  examine  the 
relationships  between  the  performance  of  the  elements  of  care,  the 
critical  criteria,  and  the  outcome  criteria.    Although  there  was  a  mix 
of  acute,  chronic,  and  preventive  care  topics,  the  criteria  sets  were 
similar  in  terms  of  the  type  and  amount  of  data  required  for  each 
topic.    The  diverse  types  of  topics  did  affect  time  frames  for  data 
collection,  however,  requiring  varying  abstracting  periods  as  shown  in 

Table  1. 
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TABLE  1.    SCPPSRO  TOPICS  AND  TIME  FRAMES 


TOPIC 
Hypertension 
Preventive  Care 

Diabetes 

Anxiety/Depression 
Chest  Pain 

Arthritis 

Urinary  Tract  Infection 


Chronic  Ischemic  Heart 
Disease 


TIME  FRAME 


2  years 


7  months  (6  months  prior  to  exam  and 
one  month  after  exam 

2  years 

2  years 

8  months  (6  months  prior  to  diagnosis 
and  2  months  after) 

2  years 

4  months  (2  months  before  diagnosis 
and  2  months  after) 

2  years 


C.     Data  Collection  and  Processing 

The  PSRO  briefly  reviewed  the  record  keeping  system  of  each  practice 
prior  to  data  collection  and  requested  the  practices  to  begin  listing 
patients  (cases)  for  each  of  the  selected  diagnoses  beginning  January  1, 
1977.    Patients  were  identified  by  physicians  or  by  office  personnel, 
using  either  automated  or  manual  techniques  for  capturing  cases.  Cases 
were  recorded  in  a  patient  identification  log  which  was  designed  by 
SCPPSRO,  and  used  to  suit  the  conventions  of  the  particular  site.  At 
the  same  time,  Blue  Shield  began  coding  primary  diagnoses  on  all  claims 
from  the  practices  to  capture  cases  by  ICDA  code  for  the  subsequent 
interface  activities  (preventive  care  and  anxiety/ depression  excepted). 

The  Group  A  co-directors  and  audit  coordinator  worked  in  conjunction 
with  the  computer  systems  analyst  to  determine  the  format  for  data 
collection.    Detailed  abstracting  instructions  and  training  materials 
were  developed  for  the  abstractors  which  minimized  the  amount  of  deci- 
sion making  or  interpretation  required  in  abstracting. 
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A  number  of  procedures  and  checks  on  abstracting  were  implemented 
to  assure  accuracy  and  resolution  of  any  problems  in  the  data  collection 
process.    The  PSRO  abstractor  used  the  patient  identification  log  to 
locate  and  retrieve  charts,  and  maintained  an  abstract  control  register 
for  all  cases  abstracted.    Abstracted  records  were  color  coded  by  study 
topic  to  prevent  reabstracting  for  the  same  topic  at  a  future  date. 
Cases  with  multiple  primary  diagnoses  encompassing  more  than  one  study 
topic  were  included  under  each  study  but  abstracted  separately.  Abstract- 
ors submitted  activity  reports  and  problem  logs  and  were  closely  super- 
vised by  the  review  coordinator.    Reabstracting  of  samples  of  patient 
records  was  performed  on  a  regular  basis  to  assure  reliability.  To 
illustrate  the  entire  data  flow  of  the  project,  HCMS  developed  a  dia- 
gram (Figure  2)  which  emphasizes  the  case  selection  and  abstracting 
process. 

The  abstracting  process  involved  direct  numerical  coding  for  data 
processing  of  all  data  items  relevant  to  the  critical  criteria  and  pro- 
cess elements  for  each  ambulatory  visit  within  the  study  time  frame. 
Most  of  the  elements  of  care  were  categorized  within  one  of  ten  major 
coding  classifications  as  follows: 


1. 

001  - 

099 

Diagnostic  Process  Ordered 

2. 

100  - 

199 

Therapeutic  Modalities 

3. 

200  - 

299 

Assessment  (Diagnosis) 

4. 

300  - 

399 

Outcome 

5. 

400  - 

499 

Subjective  Findings  (Symptoms) 

6. 

500  - 

599 

Diagnostic  Process  Performed 

7. 

600  - 

699 

Type  of  Encounter  with  Patient 

8. 

700  - 

799 

Patient  Education 

9. 

800  - 

899 

Patient  Disposition  (referral,  reappointment 
interval ) 

10. 

900  - 

999 

Physician  Recognition  of  Abnormal  Laboratory 

Values 


Abstracting  instructions  and  forms  were  pilot  tested  for  two  weeks 

prior  to  settling  on  procedures  in  all  practices.    The  PSRO  instituted  a 

quality  control  system  for  data  collection  involving  periodic  reabstraction 
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FIGURE  2 

SOUTHCENTRAL  PENNSYLVANIA  PSRO  DATA  FLOW  CASE  SELECTION 


FORM  AMBULATORY  CARE 
TASK  FORCE 


DATA  SOURCE: 
Hershey  Medical  Center 
Family  Health  Service 
Lancaster  Hospital 


SELECT  8  REVIEW  TOPICS  BASED 
ON  FREQUENCY  DATA 


ESTIMATE  CASE 
FREQUENCIES  AT 
10  SITES 


SELECT  10  GROUP  PRACTICES  AND 
OBTAIN  AGREEMENT  TO 
PARTICIPATE 


CASE  LISTING  IN  SEQUENCE  OF 
TOPICS  AT  ALL  PRACTICE 
SITES  1/1/77  TO  9/15/77 


SITE  VISIT  TO  ALL  PRACTICES 
BY  CO-DIRECTOR  AND  COORDINATOR 


TOPICS: 

1.  Hypertension 

2.  Diabetes 

3.  Preventive  Care 

4.  CIHD 

5.  UTI 

6.  Arthritis 

7.  Anxiety  Depression 

8.  Chest  Pain 


OFFICE  PERSONNEL 
LOG  TOPIC,  PATIENT 
ID  AND  DATE  OF  VISIT 


ASSURE  ACCESS  TO 
RECORD  CONFIDENTIALITY 


AMBULATORY  CARE  DATA  COLLECTION 
1/31/77  TO  10/15/77 
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SCP  DATA  FLOW  (CONT'D) 


PAGE  2    ABSTRACTING  QUALITY 

CONTROL  DATA  PROCESSING 
AND  REVIEW 


Abstracting 
Instructions 
for  8  Topics 


f  From  \ 
(  Page 


Abstracting 
at  10  Sites 
(5840  Abstracts) 


Abstract  Data 
Quality  Control 
and  Edit 


Manual 
Tabulation 


Computer 
Data  Entry 


Prel iminary 
Review  and 
Analysis 


Computer  Data 
Qual ity  Control 
and  Edit 


Prel iminary 
Listings 


■ 

List  of  Variations 
by  Topic 

Computer 
Analysis 

Hold  for 

Interface 

Study 

SCP  DATA  FLOW  (CONT'D) 
PAGE  3  FEEDBACK 


Site  Intervention  Dates 

1.  Hypertension 

1/78 

2.  Diabetes 

2/78 

3.  Preventive  Care 

3/78 

4.  Chronic  Ischemic 
Heart  Disease 

4/78 

5.  Urinary  Tract 
Infection 

6/78 

6.  Arthritis 

6/78 

7.  Anxiety/Depression 

6/78 


8. 


Chest  Pain 
6/78 


Variations 
by  Top 
by  Si  1 

.  (Cases) 

)ic 

:e 

} 

Prepare 
Data  Displays 
for  Sites 

r 

Present  Displays 
to  Site 
Representatives 

Review  Site 
Comments 

Summarize  Variations 
Justifications 
and  Deficiencies 

Site  May  Offer 
Justification  or 

Suggest 
Corrective  Action 


Site  May  Take 
Corrective  Action 


17 


of  samples  of  records  which  yielded  a  high  reliability  rate.*  Data 
collection  was  carried  out  for  each  topic  in  sequence  for  a  period  of 
eight  months.    A  total  of  5,844  cases  were  abstracted  for  all  topics 
combined.    Frequencies  of  cases  reviewed  by  site  and  by  topic  are  dis- 
cussed in  the  next  section  of  this  report. 

The  office  audit  data  was  keypunched  to  tape  by  the  Blue  Shield 
Data  Entry  Department.    Computer  edits  identified  nonsense  dates  and 
codes  and  duplicate  process  codes,  and  checked  for  the  presence  of 
clinical  values  and  the  completeness  of  vital  fields.    After  editing 
data  displays  were  produced,  including: 

1 .  Patient  profi les 

2.  Critical  criteria  summaries  for  each  practice 

3.  Summary  of  process  elements  by  patient 

4.  Frequency  distribution  of  process  elements  by  physician 

5.  Summary  of  frequency  distributions  of  process  elements  by  site 

6.  Summary  of  frequencies  of  process  elements  by  physician 

Reduction  of  data  and  preparation  of  data  displays  was  done  manually 
by  abstractors,  using  machine-generated  frequency  data. 

Data  processing  for  the  claim  based  component  proceeded  concurrently. 
Blue  Shield  produced  the  following  data  displays  as  the  claim  data  base 
was  collected: 

1.  Summaries  of  diagnoses  at  the  participating  practices 

2.  Two-year  patient  histories  from  claim  files 

3.  Practice  summaries 

*Reabstracting  of  hypertension  cases  resulted  in  a  reliability  rate  of 
95.6%  as  reported  by  SCPPSRO. 


18 


Interface  activities  required  both  automated  and  manual  analysis. 
Matching  of  patients  between  the  audit  and  PBS  claim  file  was  the  first 
step,  involving  computer  matching  of  dates  of  service  and  manual  review 
of  procedures  on  a  case-by-case  basis,  to  determine  true  matches.  The 
matching  technique  was  pilot  tested  during  the  second  project  year,  but 
major  interface  efforts,  including  comparing  AMCRO  interface  profiles  to 
PSRO  areawide  profiles,  were  scheduled  for  completion  during  the  project 
extension  period  following  the  second  project  year. 

The  following  analyses  will  be  required  to  examine  the  relationship 
between  critical  criteria  and  elements  of  care. 

1.  Simple  correlations  between  all  possible  pairings  of  criteria 
and  variables 

2.  Quantification  of  correlations  (ANOVA  and  cluster  analysis) 

The  correlation  studies  will  be  undertaken  to  define  elements  for  the 
claim  system  which  are  predictors  of  quality  care,  as  well  as  to  form 
the  basis  of  a  refined  criteria  set  for  in-depth  office  audit.    The  data 
used  in  analysis  are  discussed  further  in  the  following  sections  of  this 
report. 

Frequencies  of  data  elements  from  a  5%  sample  of  office  audit  data 
were  computed  by  HCMS  to  determine  data  availability  for  process  elements 
associated  with  the  critical  criteria  as  well  as  for  elements  not  asso- 
ciated with  them.    The  summaries  provide  an  indication  of  the  proportion 
of  data  elements  which  were  used  consistently  in  feedback  (elements 
associated  with  the  critical  criteria)  as  well  as  the  overall  proportion 
of  data  elements  which  provided  some  information  yield.    Data  availability 
studies  are  discussed  later  in  this  report. 
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D.  Data  Analysis,  Review  and  Decision  Making 

The  initial  responsibility  for  reviewing  data  relating  to  the  in- 
depth  office  audit  rested  with  the  Group  A  co-directors,  who  utilized 
consultants  as  necessary.    The  results  of  the  reviews  were  submitted  to 
,  the  AMCRO  Task  Force  for  analyzing  findings  and  comparing  results. 

Displays  produced  for  review  which  were  also  used  for  intervention 

« 

included: 

1.  Age  and  sex  distributions 

2.  Variations  by  physician  for  critical  criteria 

3.  Elements  of  care  frequencies 

4.  Elements  of  care  frequency  ranking  relative  to  other  sites 

5.  Other  data  displays  relevant  to  topic  (e.g.,  clinical  values 
were  reviewed  for  hypertension) 

The  basis  of  the  review  component  was  determining  compliance  with 
critical  criteria  and  thus  identifying  physician  and  practice  variations. 
Ranking  of  sites  for  performance  of  each  process  element  was  used  as  a 
simple  means  of  identifying  potential  over-  and  underutilization.  For 
certain  topics,  the  PSRO  related  critical  criteria  to  associated  pro- 
cedure elements  or  performed  special  analyses  of  selected  procedures 
where  considerable  variation  was  found. 

E.  Intervention 

The  variation  rates  and  performance  rankings  were  presented  to  each 
practice  in  sequence  by  topic.    For  the  first  topic,  hypertension,  the 
»  intervention  was  conducted  by  means  of  individual  site  visits.    For  all 

subsequent  topics,  review  data  was  presented  at  joint  meetings  of 
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site  representatives.    The  PSRO  discussed  the  results,  including  perform- 
ance on  critical  criteria,  variations  and  practice  rankings  for  process 
elements,  and  special  studies  conducted  for  each  topic.    The  PSRO  did 
not  recommend  corrective  action  strategies  to  the  practices  but  left 
specific  decision  making  up  to  the  practices  themselves.    A  copy  of 
intervention  materials  for  the  topic  Chest  Pain  is  found  in  Appendix  B. 

Practice  response  checklists  were  distributed  to  the  practice 
representatives  to  solicit  justifications  for  variations  or  agreement  on 
variations,  signifying  a  consensus  on  true  deficiencies.    The  form  also 
requested  information  on  the  mode  of  corrective  action  adopted  by  the 
practices  in  response  to  variations  in  critical  criteria. 

The  project,  as  designed,  made  no  attempt  to  control  the  interven- 
tion process  after  the  PSRO  staff  presented  the  data.    No  format  for 
variation  analysis  was  imposed,  and  as  a  result,  variation  analysis  and 
deficiency  determination  were  subjective  decisions  made  by  one  or  more 
physicians  in  each  practice  site.    Standards  for  this  process  varied 
widely  across  practices  and  within  many  of  the  practices.    In  many  cases 
the  variation  analysis  was  done  on  a  subset  of  patients.    These  patients 
were  not  selected  randomly  but  on  the  basis  of  their  cases  being  potential 
the  most  significant  and  productive.    Thus,  the  results  of  the  analysis 
could  not  be  extrapolated  to  the  entire  practice  sample.  Justifications 
in  the  variation  analysis  were  not  defined  as  a  part  of  the  feedback 
design  since  individual  providers  were  not  identified. 

After  intervention  for  each  topic,  relogging  of  study  cases  began 
at  the  practices  in  preparation  for  the  restudy  cycle.    Analysis  of 
restudy  cases  was  not  completed  within  the  two-year  project  time  frame, 
but  will  be  done  during  the  extension  period. 

21 


SECTION  III 
ANALYSIS  OF  DESIGN  AND  PLANNING 
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INTRODUCTION 

In  an  effort  to  identify  the  requirements  essential  for  developing 
a  Professional  Standards  Review  Organization  (PSRO)  ambulatory  care 
quality  assurance  capability,  Health  Care  Management  Systems,  Inc.  (HCMS) 
developed  and  administered  two  questionnaires  to  PSRO  ambulatory  care 
review  system  personnel  participating  in  the  demonstration  program.  The 
information  gained  from  the  questionnaires  is  intended  for  use  by  federal 
officials  and  PSRO  leadership  in  highlighting  design,  planning  and  opera- 
tion activities  that  must  be  accomplished  in  establishing  the  foundation 
for  a  successful  ambulatory  review  program. 

The  First  Year  Questionnaire:  Planning 

The  questionnaire  covered  four  major  planning  areas:    1)  development 
of  the  basic  conceptual  design  of  the  review  system,  2)  project  manage- 
ment (e.g.,  formation  and  responsibilities  of  the  project  management 
committee  and  project  staffing  requirements),  3)  demonstration  project 
relationships  with  other  PSRO  organizational  units  (the  PSRO  Board  and 
standing  committees),  and  4)  relationships  with  groups  and  organizations 
external  to  the  PSRO  (PSRO  members  and  providers  associated  with  the 
demonstration  project  as  volunteer  participants,  consultants,  and  the 
analysis  contractor).    The  methods  used  to  construct,  administer,  and 
analyze  the  questionnaire  are  reported  on  pages  8-12  of  Appendix  1, 
"Interim  Report  Cooperative  Demonstration  and  Analysis  of  Ambulatory 
Care  Quality  Assurance  Review  Methodology  in  PSRO  Settings."    Data  was 
analyzed  across  all  PSRO  projects  and  findings  reported  below  reflect 
the  opinion  of  aggregated  demonstrated  project  participants. 
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The  Second  Year  Questionnaire:    Design  and  Operations 

The  second  questionnaire  focused  more  specifically  on  the  actual 
success  of  each  site's  project  design  and  resultant  operation.  A 
substantial  number  of  items  were  aimed  at  management  and  administra- 
tion issues.    Other  items  questioned  resources  and  funding  and  methods 
for  topic  selection,  criteria  development,  data  collection  and  pro- 
cessing, review  and  decision  making,  and  intervention.    The  questionnaire 
was  divided  into  two  sections.    Whereas  the  first  year  questionnaire 
was  analyzed  across  all  PSRO  projects,  the  second  year  questionnaire 
was  analyzed  both  by  individual  project  (Section  I)  and  across  projects 
(Section  II).    The  findings  from  Section  I  are  reported  below;  the 
findings  from  Section  II  are  found  in  Volume  II  of  this  report. 

SYNOPSIS  OF  FIRST  YEAR  FINDINGS 

Twenty  requisites  and  five  additional  elements  for  a  planning 

process  were  extracted  from  interviews  with  25  ambulatory  care  quality 

review  system  planners  participating  in  five  demonstration  projects. 

Overall,  20  requisites  (numbered)  for  planning  were  identified  and 

five  elements  (E)  came  very  close  to  meeting  requisite  criteria. 

1.      Involve  the  PSRo  Board  in  the  review  of  progress  reports 
concerning  ambulatory  care  quality  assurance  system 
activities. 

El.     Prior  approval  of  ambulatory  care  quality  assurance 
objectives  by  the  PSRO  Board  is  essential  to  avoid 
committing  resources  to  activities  that  are  later 
abandoned. 

Two  respondents  said  that  PSRO  Board  approval  for  their  demonstra- 
tion projects  was  obtained  on  the  basis  of  little  information  on  Board 
members'  part.    Since  original  approval  of  the  project,  according  to 
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ten  respondents,  the  Board  has  not  been  active  in  project  activities 
other  than  receiving  reports,  primarily  at  Board  meetings.  Health 
Standards  and  Quality  Bureau  (HSQB)  required  Board  approval  of  PSRO 
participation  in  the  demonstration  program.    The  one  PSRO  which  did  not 
continue  to  participate  in  the  program  did  not  obtain  prior  Board 
approval.    Two  respondents  from  this  project  emphasized  the  need  for 
Board  agreement  and  approval  of  project  objectives  before  the  initia- 
tion of  activities  in  order  to  avoid  wasting  resources. 

2.  Assure  that  all  participants  in  review  system  design  and 
operation  (PSRO  staff,  PSRO  consultants,  the  funding 
agency  and  the  analysis  contractor)  have  a  complete  and 
common  understanding  of  PSRO  ambulatory  care  quality 
assurance  system  goals,  objectives  and  philosophy. 

Eight  respondents  emphasized  the  need  for  all  review  system 

planners  (PSRO  professionals,  staff  and  consultants  to  the  PSRO)  to 

have  an  early  understanding  of  the  goals.    They  felt  this  might  keep 

activities  peripheral  to  the  goals  from  draining  resources  at  a  later 

date.    One  respondent  emphasized  the  need  to  put  the  goals  in  written 

form  to  serve  as  an  unambiguous  reminder  to  all  throughout  the  review 

system  planning  phase.    Another  thought  that  a  common  understanding  was 

particularly  important  when  the  personnel  from  more  than  one  organization 

are  involved  in  project  design  and  planning.    Respondents  also  emphasized 

the  need  for  a  common  understanding  between  project  participants,  the 

funding  agency  and  the  analysis  contractor. 

3.  Attract  a  core  individual  or  individuals  to  the  review 
system  to  assure  the  continuing  momentum  of  review 
system  design. 

Five  respondents  mentioned  the  necessity  of  involving  a  person 
or  persons  with  both  a  well -formulated  review  system  core  idea  and 
the  time  and  dedication  to  devote  to  nursing  that  concept  through 
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the  stages  of  review  system  planning.    Such  a  dedicated  leadership 
is  required  to  provide  continuity  and  assure  continuing  momentum, 
and  particularly  to  refine  the  conceptual  base  of  the  review  system 
as  project  planning  progresses.    These  critical  persons  are  required 
for  assembling  staff  resources  and  for  interaction  with  the  various 
physician  groups  during  the  review  system  planning  phase.    One  of  the 
respondents  said  that  as  planning  progresses  and  project  staff  other 
than  core  individuals  begin  to  understand  the  details  of  the  review 
system  concept,  the  dependence  of  project  planning  on  this  core  declines: 

4.  Attract  to  the  review  system  planning  team  a  medical 
leader  whose  opinion  is  valued  by  community  physicians. 

Four  respondents  emphasized  that  the  involvement  of  a  medical 

leader  whose  opinion  is  respected  by  community  physicians  and  by  all 

project  planners  was  important  to  the  planning  phase.    The  medical 

leader's  importance  lies  in  his  ability  to  coordinate  the  sometimes 

diverging  perspectives  of  the  various  project  planners.    One  person 

who  speaks  with  authority  is  required  to  resolve  potential  conflicts 

and  demonstrate  to  planners  the  wisdom  of  certain  resolutions. 

5.  Define  consultant  role  and  tasks  as  specifically  as 
possible  to  maximize  consultant  usefulness  to  review 
system  planning. 

Six  respondents  felt  that  consultants  outside  the  PSRO  could  offer 
significant  assistance  to  ambulatory  care  review  system  planners.  Two 
respondents  emphasized  the  need  for  the  PSRO  to  specifically  define  the 
consultant's  tasks  and  expectations  early  in  the  PSRO-consultant  relationship. 

Three  review  system  planners  provided  suggestions  on  how  to  enhance 
the  usefulness  of  the  analysis  contractor  in  his  role  as  technical  con- 
sultant during  the  planning  process.    While  these  respondents  felt  that 
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the  analysis  contractor  was  quite  helpful  in  identifying  areas  of  the 
project  that  required  clarification,  they  thought  that  the  contractor 
should  have  taken  a  more  active  role  in  helping  the  planners  to  resolve 
these  issues.    While  these  particular  respondents  did  not  specifically 
so  mention,  two  others  mentioned  the  need  to  clarify,  at  an  early  date, 
the  role  to  be  assumed  by  the  analysis  contractor,  especially  in  the 
area  of  technical  consultation. 

6.  Designate  one  review  system  planning  team  member  to 
coordinate  and  rewrite  planning  documents,  integrating 
sections  produced  by  various  other  system  designers. 

7.  Include  on  the  review  system  planning  staff  one  person 
at  the  full-time  or  nearly  full-time  level  responsible 
for  coordinating  the  technical  activities  for  daily 
review  system  planning. 

E2      It  is  useful  to  include  on  the  review  system  planning 

team  a  person  with  skills  in  system  design  and  knowledge- 
able in  the  daily  operation  of  review  system  activities. 

Six  respondents  saw  the  need  to  include  a  full -time  or  nearly  full- 
time  PSRO  staff  member  to  coordinate  planning  and  manage  eht  operation 
of  the  review  system;  also,  as  one  respondent  mentioned,  this  full- 
time  staff  member  is  needed  to  attend  to  the  time-consuming  tasks  and 
the  myriad  of  details  that  arise  in  such  an  enterprise.    Three  respondents 
emphasized  the  importance  of  this  person  having  skills  in  system  design 
and  management  of  day-to-day  activities. 

8.  Emphasize  to  review  system  planners  that  planning  activities 
are  evolutionary  and  that  they  can  expect  testing  and 
revision  to  continue  beyond  the  initial  drafting  of  a  system 
design. 

Seven  planners  mentioned  the  difficulty  of  producing  planning 
documents  that  anticipated  the  future  details  of  their  proposed  ambu- 
latory care  review  systems.    Five  respondents  mentioned  that  planning 
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activities  would  continue  beyond  the  planning  phase  and  into  the  opera- 
tional phase.    They  emphasized  that  it  is  impossible  during  the  plan- 
ning phase  to  anticipate  all  the  contingencies  that  might  develop  in 
the  operation  of  the  review  system.    One  respondent  said  that  concept 
development  is  evolutionary,  requiring  modification  as  difficulties 
arise.    Others  said  that  alternative  solutions  to  problems  that  are 
anticipated  during  planning  can  often  only  be  investigated  in  an  opera- 
tional environment.    Two  respondents  mentioned  that  while  the  general 
review  system  design  and  initial  steps  can  be  finalized  during  plan- 
ning, the  details  must  await  operational  activities.    One  respondent 
thought  review  system  design  might  entail  a  trial-and-error  process 
for  certain  problems. 

9.      Implement  selected  feasibility  tests  of  the' review 
system  components  to  enhance  planning  prior  to 
committing  resources  to  larger-scale  operational 
activities. 

Nine  respondents  said  that  a  feasibility  test  of  some  of  the 
uncertainties,  utilizing  fewer  records  than  the  operational  review 
system  would  later  involve,  would  have  been  helpful.    Commonly  suggested 
review  system  components  for  feasibility  tests  were:    1)  the  abstract 
form,  and  2)  a  determination  of  what  data  were  likely  to  be  found  in 
the  ambulatory  record  and  might  thus  be  included  for  quality  review. 
Four  of  the  nine  respondents  thought  that  a  limited  pilot  study  of 
the  entire  review  system  would  have  been  helpful,  although  several 
viewed  the  demonstration  project  itself  as  a  pilot  study.    The  other 
five  respondents  felt  that  since  a  limited  amount  of  time  was  provided 
for  the  demonstration  project,  a  pilot  study  of  the  entire  review 
system  was  not  possible;  that  the  preparation  required  for  such  a 
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test  was  as  extensive  as  was  required  for  operating  the  actual  demon- 
stration review  system  and  was,  therefore,  not  an  efficient  use  of 
project  resources. 

10.     Make  review  system  staff  aware  of  the  purpose  and  demands 
of  planning  in  order  that  these  demands  do  not  dampen 
their  enthusiasm. 

E3.     Specific  deadlines  for  review  system  planning  and  planning 
documents  tend  to  expedite  those  activities  within  busy 
PSROs. 

Two  respondents  commented  on  a  related  issue,  the  effect  that 
extended  planning  periods  had  on  project  staff.    These  respondents  felt 
that  staff  enthusiasm  for  the  demonstration  project  was  jeopardized 
at  times  by  an  inability  to  investigate,  in  an  operational  setting, 
what  everyone  perceived  were  uncertainties  concerning  project  design. 
One  of  these  respondents  as  well  as  a  third  thought  that  project  inter- 
action with  outside  monitoring  (HSQB  and  the  analysis  contractor) 
should  be  more  intensive  over  a  shorter  period  of  time  in  order  to 
produce  an  improved  planning  process  and  allow  earlier  testing  of  the 
review  system  design. 

Responses  varied  concerning  the  amount  of  time  allotted  to  writing 
planning  documents.    Four  respondents  felt  that  a  sufficient  amount  of 
time  was  available  for  the  production  of  the  concept  paper,  the  pre- 
liminary and  the  final  plans.    Six  felt  that  they  could  have  used 
more  time.    Three  respondents  mentioned  the  difficult  and  time-consuming 
tasks  of  integrating  the  concerns  of  everyone  participating  in  project 
planning  (staff,  consultants,  HSQB  and  the  analysis  contractor)  into 
one  coherent  planning  document.    Three  of  those  who  felt  that  sufficient 
time  was  available  for  writing  documents  (planners  who  were  not  directly 


29 


involved  in  the  writing)  thought  that  if  more  time  had  been  allotted, 
the  document  writing  would  have  consumed  that  time  without  producing 
plans  of  a  higher  quality  or  containing  any  more  detail;  these  respon- 
dents felt  that  deadlines  served  the  function  of  expediting  organizational 
activities. 

11.     Include  on  a  review  system  management  committee  representa- 
tives of  those  physicians  whose  ambulatory  care  will  be 
reviewed. 

E4      Inclusion  of  key  physicians  skeptical  of  ambulatory  care 
quality  assurance  in  management  activities  can  help 
assure  that  their  skepticism  does  not  become  opposition. 

Each  of  the  five  PSROs  participating  in  the  demonstration  project 

formed  a  management  committee  to  oversee  the  planning  and  operation 

of  their  review  systems.    Five  respondents  mentioned  the  importance  of 

including  on  that  committee  representatives  of  the  physicians  whose 

medical  care  would  be  reviewed  so  that  a  liaison  could  be  established 

between  the  review  system  and  the  individual  physicians.    The  liaison, 

a  physician,  would  convey  the  concerns  of  his  constituents  to  the 

PSRO,  guaranteeing  communication  between  the  physician  community  and 

the  ambulatory  review  system  managers.    Representatives  from  hospital 

staffs,  according  to  the  five  respondents,  can  serve  as  the  liaison 

between  the  PSRO  and  community  physicians  since  most  physicians  are 

associated  with  a  hospital.    Two  respondents  mentioned  that  their 

review  system  management  committee  included  a  physician  who  had  a 

skeptical  attitude  toward  the  review  of  ambulatory  care  and  who  was 

recruited  for  the  committee  to  assure  that  his  skepticism  did  not 

become  opposition. 
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12.     Indicate  to  planners  that  they  should  expect  that  PSRO 
members  will  express  little  desire  to  become  involved 
in  review  system  planning  activities. 

Seven  review  system  planners  said  that  although  the  PSRO  general 

membership  was  notified,  it  expressed  little  desire  to  participate  in 

planning  activities.    Several  respondents  were  surprised  that  the 

physician  community  did  not  express  more  negative  reactions  concerning 

ambulatory  review.    Only  one  respondent  stated  that  a  "couple"  of  PSRO 

physicians  responded  by  volunteering  for  project  committees.  Another 

respondent  elicited  little  reaction  from  physicians  even  after  his 

personal  explanations  of  the  project.    Five  respondents  explained  that 

notification  usually  occurred  through  the  PSRO  newsletter,  although 

in  two  projects  the  PSRO  annual  meeting  was  also  used  to  inform  the 

membership.    In  either  case  only  a  general  project  description  was 

provided. 

E5      Inclusions  of  the  PSRO  membership  in  the  design  and 
operation  of  the  ambulatory  care  quality  assurance 
system  should  await  its  testing  in  order  not  to  arouse 
premature  opposition. 

Nine  respondents  felt  that  it  was  premature  at  this  time  to  involve 
the  PSRO  general  membership  in  the  details  of  the  design  and  operation 
of  the  ambulatory  care  review  system.    These  planners  felt  that  the 
membership  should  not  be  involved  until  review  was  perfected  and  a  well- 
developed  and  tested  system  could  be  presented  to  them.    Two  of  these 
planners  specifically  mentioned  the  danger  of  arousing  opposition  to 
ambulatory  review,  opposition  that  would  "muddy  the  waters"  for  the 
future  and  defeat  ambulatory  review  before  it  had  a  chance  to  develop. 

Sentiment  on  this  point  was  not  unanimous.    One  respondent  felt 
that  the  benefits  to  be  gained  by  increased  membership  interest  in 
the  PSRO  and  the  ambulatory  project  were  worth  risking  the  potential 
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opposition  that  might  occur  through  such  involvement.    Another  felt 
that  should  disharmony  develop,  project  planning  should  include  the 
"loyal  opposition."    Another  respondent  from  the  same  project  felt 
that  as  many  physician  groups  as  possible  should  participate  in  order 
to  legitimize  the  project  within  the  medical  community. 

13.  Recruit  from  the  review  system  and  employ  as  representa- 
tives to  the  physician  community  those  physicians  with 
strong  personal  ties  to  the  groups  of  physicians  whose 
ambulatory  care  will  be  reviewed. 

14.  Identify  local  medical  community  opinion  molders  and 
enlist  them  as  personal  ambassadors  from  the  PSRO. 

Thirteen  respondents  emphasized  that  a  critical  factor  in  gain- 
ing physician  participation  in  the  demonstration  project  was  a  personal 
relationship  between  a  physician  representing  the  review  system  and 
the  physicians  whose  ambulatory  care  was  to  be  reviewed.    In  all  the 
projects  this  personal  relationship  was  one  that  had  developed  prior 
to  the  demonstration  project.    It  was  employed  in  obtaining  physician 
volunteers  for  the  project  through  letters,  telephone  calls  and  actual 
personal  contracts.    In  the  two  projects  associated  with  hospitals 
representatives  of  medical  staffs  were  used  to  encourage  physician 
participation  in  the  demonstration  project.    Members  of  committees  in 
one  project  were  selected  in  large  measure  on  the  basis  of  their 
potential  ability  to  gain  the  cooperation  of  physician  volunteers. 
One  respondent  said  that  had  physicians  been  asked  anonymously  to 
volunteer  to  have  their  ambulatory  care  reviewed  they  would  have 
refused.    The  "peer  pressure"  implied  by  personal  contact  with  a  PSRO 
physician  representative  generated  the  cooperation.    Two  other  respon- 
dents mentioned  that  securing  the  cooperation  of  physicians  in  their 
areas  required  repeated  personal  contact  with  the  potential  volunteers. 
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One  project,  in  an  effort  to  obtain  the  participation  of  one  physician 
in  a  small  group  practice,  actually  obtained  the  participation  of  all 
members  of  that  group  through  contact  with  the  one  group  member.  Five 
respondents  saw  the  need  for  PSROs  to  identify  the  opinion  molders  in 
each  locality  who  would  serve  as  personal  ambassadors  from  the  PSRO  to 
the  physician  and  generate  support  for  ambulatory  care  quality  assurance 
activities.    Permission  to  review  the  ambulatory  care  of  physicians 
practicing  in  the  outpatient  department  of  a  project  hospital  was  secured 
through  the  hospital  administration,  and  each  individual  physician  did 
not  need  to  be  recruited. 

15.  Emphasize  to  the  participating  physician  community  that 
the  review  system  will  provide  the  physician  with  informa- 
tion useful  to  his  practice. 

Five  respondents  felt  that  one  of  the  best  methods  of  eliciting 

cooperation  from  volunteer  physicians  whose  care  will  be  reviewed  is 

to  agree  to  provide  the  physicians  with  feedback  of  review  results. 

One  respondent  said  that  volunteers  feel  that  review  may  be  used  to 

gain  some  knowledge  about  their  practices  without  any  expense  on  their 

part.    Another  felt  that  it  was  important  to  provide  feedback  as  quickly 

as  possible.    The  importance  of  providing  positive  as  well  as  negative 

feedback  to  the  physician  was  also  emphasized.    Some  physician  volunteers, 

according  to  one  respondent,  made  the  provision  of  feedback  a  condition 

for  their  participation. 

16.  Emphasize  to  those  physicians  whose  ambulatory  care  will 
be  reviewed  by  the  quality  assurance  system  that  their 
early  and  willing  cooperation  will  avoid  the  imposition 
of  a  system  from  outside  the  local  medical  community. 
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Fourteen  respondents  felt  that  an  important  factor  in  attracting 
volunteers  to  ambulatory  review  activities  was  the  desire  of  the  physi- 
cians themselves  to  become  involved  in  a  physician-led  effort  to  estab- 
lish ambulatory  care  quality  assurance  systems,  thus  avoiding  nonphysician 
design  of  systems  that  may  possibly  have  antithetical  consequences  for 
them.    Two  respondents  specifically  mentioned  physicians'  concern  with 
the  imposition  of  an  unworkable  system  by  the  federal  government,  one 
not  attumed  to  local  needs.    Two  other  respondents  said  that  the  PSRO 
emphasized  to  potential  volunteers  the  opportunity  to  influence,  through 
the  demonstration  project,  the  evolving  federal  policy  toward  ambulatory 
care  quality  assurance.    One  of  these  respondents  informed  volunteers 
of  previous  PSRO  experiences  in  influencing  policy. 

17.     Prepare  system  planners  to  expect  that  physicians  whose 
care  is  being  reviewed  require  few  details  concerning 
the  technical  operation  of  the  review  system  during  the 
planning  phase. 

Seven  respondents  mentioned  that  the  physician  volunteers  requested 
general,  not  detailed,  information  concerning  the  proposed  review  system. 
This  information  was  supplied  to  them  in  both  written  and  verbal  form. 
Two  respondents  from  different  projects  mentioned  that  a  personal  con- 
tact session  of  only  10  or  15  minutes  was  necessary  to  explain  project 
objectives  and  procedures,  and  few  volunteers  requested  additional 
detail.    One  respondent  mentioned  that  volunteers  were  more  concerned 
with  the  degree  to  which  review  system  activities  would  affect  them 
than  with  the  system's  technical  details.    Another  respondent  said 
that  volunteers  were  concerned  about  what  the  review  system  would  cost 
them.    Volunteers  were  interested  in  what  criteria  would  be  used  in 
evaluating  their  ambulatory  care.    A  respondent  from  a  project  associated 
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with  PSRO  area  hospitals  confirmed  that  the  hospitals  were  also  inter- 
ested in  a  general,  and  not  a  detailed,  description  of  the  proposed 
review  system. 

18.  Prepare  system  planners  to  expect  that  physician  volun- 
teers whose  ambulatory  care  is  being  reviewed  will  express 
little  interest  in  participating  in  the  design  or  the 
technical  activities  of  operating  the  review  system. 

Six  respondents  said  that  the  physician  volunteers  were  not  inter- 
ested in  participating  in  the  design  or  operation  of  the  ambulatory 
care  review  system.    Five  of  these  said  that  none  of  the  volunteers 
expressed  any  desire  to  become  involved.    The  sixth  respondent  said 
that  a  few  did  express  a  desire,  while  other  physician  volunteers 
offered  suggestions.    The  majority  of  volunteers,  however,  were  not 
interested  in  the  technical  details  of  the  review  system.    One  respon- 
dent felt  that  the  physicians  were  comfortable  in  delegating  this 
responsibility  to  their  project  representative.    Another  felt  that  they 
simply  did  not  have  the  time  for  such  activities  and  that  some  mechanism 
should  be  created  to  allow  them  the  level  of  involvement  that  their 
time  permits. 

19.  Assure  that  review  system  activities  do  not  interfere  with 
the  physician's  office  routine. 

Five  respondents  mentioned  that  physician  volunteers  concerned 
that  review  system  activities  might  interfere  with  office  routine. 
One  potential  volunteer  decided  not  to  participate  in  the  demonstra- 
tion project  because  of  what  he  saw  as  potential  disruption  to  his 
practice.    Two  respondents  said  that  this  project  goal  was  to  demon- 
strate that  effective  quality  assurance  systems  can  be  developed  and 
operated  without  interfering  with  office  routine. 
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20.     Assure  the  confidentiality  of  all  physician  and  patient 
information. 

Nine  respondents  mentioned  that  physician  volunteers  were  con- 
cerned that  the  medical  record  data  remain  confidential.    They  were 
apprehensive  about  the  potential  dangers  involved  in  breaching  patient 
privacy  by  releasing  information.    Another  concern  was  whether  the 
physician  maintained  legal  custody  of  the  medical  information  and 
could  release  it  for  quality  review  activities  without  risking  any 
patient-initiated  legal  consequences.    One  respondent  said  that  volun- 
teers were  most  concerned  about  the  identification  of  the  physician. 
Another  mentioned  that  the  PSRO  anticipated  the  problem  and  had  assured 
confidentiality  of  all  data  in  the  initial  PSRO  letter  inviting  physi- 
cians to  participate  in  the  project.    Still  another  stated  that  this 
potential  problem  was  mitigated  by  PSRO  confidentiality  policies.  Two 
physician  respondents  felt  that  the  confidentiality  issue  was  not  the 
real  issue  but  was  being  used  by  some  as  an  excuse  for  not  participating 
in  quality  assurance  activities. 
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SECOND  YEAR  FINDINGS 


Method 

Subjects  and  Questionnaire  Development 

The  subjects  for  the  survey  were  87  persons  who  were  involved  in 
various  aspects  of  the  demonstration  projects  in  the  five  sites.  For 
analysis  purposes,  subjects  were  classified  according  to  their  role  in 
the  demonstration  project  (e.g.,  PSRO  staff  or  physician,  physician  or 
nonphysician  consultant,  abstractor  and  other).    Also,  they  were  classified 
according  to  their  level  and  type  of  involvement  in  the  project. 

The  questionnaire  was  composed  of  two  sections.    The  first  section 
had  18  objective  items  where  the  respondent  was  requested  to  circle  one 
of  three  answer  choices  which  best  described  their  position  and  then 
indicate  the  strength  of  their  position  along  the  continuum  from  strongly 
agree  to  strongly  disagree.    If  respondents  felt  strongly  about  a  question, 
they  had  the  option  of  answering  more  than  one  choice. 

The  second  section  is  comprised  of  a  mixture  of  22  open  and  closed 
questions.    The  bulk  of  these  questions  focus  on  describing  the  PSRO 
demonstration  experience  to  provide  technical  assistance  to  new  PSROs 
beginning  ambulatory  care  review  programs. 

The  questionnaire  development  began  with  staff  review  of  over  150 
articles,  books,  and  papers  on  the  topic  of  quality  assurance.  Each 
reference  was  read  to  extract  relevant  information  on  ambulatory  care 
quality  assurance.    A  listing  of  strengths  and  weaknesses  in  conducting 
ambulatory  quality  assurance  was  comprised.    Special  problems  in  the 
evaluation  of  ambulatory  care  were  also  noted  within  the  literature. 
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HCMS'  previous  experience  with  ambulatory  care  quality  assurance 
projects  was  then  used  to  build  a  model  for  reviewing  care  rendered  in 
the  office  setting.    The  model  was  comprised  of  three  cycles:  screening, 
action,  and  restudy.    The  components  of  the  model  consisted  of  such 
factors  as  selection  of  topics  or  providers,  criteria  development, 
review  and  decision  making,  and  impact  assessment. 

From  this  model  HCMS  staff  developed  a  list  of  issues  being  investi- 
gated within  each  site.    These  issue  lists  were  site  specific  but  gave  a 
picture  of  the  issues  and  problem  areas  facing  each  of  the  demonstration 
sites.    From  the  issue  lists  a  common  thread  of  issues  across  all  sites 
was  determined.    HCMS  and  HSQB  staff  discussions  were  also  held  to 
review  the  entire  ambulatory  care  demonstration  evaluation  effort.  Such 
discussions  when  combined  with  the  issue  lists  and  model  tended  to  focus 
survey  attention  on  the  future  of  ambulatory  care  rather  than  objectively 
determining  what  each  site  did  or  didn't  do  and  why. 

From  this  process  a  list  of  76  questions  were  developed.  These 
questions  were  all  open  ended.    In  order  to  better  quantify  some  of  them 
and  eliminate  others,  a  sample  of  32  questions  was  discussed  face  to 
face  with  a  group  of  people  working  on  the  demonstration  at  one  of  the 
sites.    HCMS  staff  reviewed  the  interpretations  given  to  the  questions 
as  well  as  the  responses.    The  interpretations  and  points  of  uncertainty 
displayed  by  PSRO  personnel  were  then  utilized  by  HCMS  staff  to  revise 
the  list  of  questions  and  convert  others  to  objective  (closed  ended) 
questions.    This  process  also  assisted  in  determining  relevance  of 
questions  as  well . 
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A  draft  of  the  survey  was  prepared  in  late  August,  1978.    The  HCMS 
staff  critically  reviewed  the  questions  and  a  final  draft  was  prepared 
on  September  1,  1978.    A  letter  soliciting  cooperation  support  from  Dr. 
Michael  Goran  of  HSQB  and  a  personal  letter  with  directions  for  survey 
dissemination  were  mailed  to  each  of  the  Executive  Directors  within  each 
site.    Each  Executive  Director  was  then  requested  to  disseminate  the 
survey  together  with  a  self-addressed  stamped  folder  to  each  of  the  key 
people  involved  in  the  project.    The  list  of  people  were  derived  after 
HCMS  reviewed  cost  log  voucher  data  from  each  site  and  confirmed  each 
list  of  names  with  each  Executive  Director. 

Complete  packages  of  surveys  and  return  envelopes  were  mailed  to 
each  Executive  Director  in  the  second  week  of  September.    A  two-week 
turn  around  was  requested  in  the  letter  which  accompanied  each  of  the 
surveys . 

A  series  of  follow-up  calls  from  HCMS  were  required  to  obtain 
responses  from  each  of  the  sites.    After  seven  weeks,  data  analysis 
began  and  no  more  questionnaires  were  accepted. 

The  final  response  rate  was  44  or  51%.    The  majority  of  those 
nonrespondents  were  physicians  who  served  as  consultants  to  the  project 
in  its  beginning  stages. 

Data  Analysis 

For  each  individual  project,  responses  in  Section  I  of  the  question- 
naire were  tallied  on  a  three-point  scale;  choices  1  and  2  (agree)  and 
4  and  5  (disagree)  were  collapsed.    Since  several  items  were  mutually 
exclusive,  if  a  respondent  had  conflicting  responses  indicating  he  did 
not  understand  the  item,  these  responses  were  eliminated  from  the  data 


39 


base.    From  a  total  response  rate  of  1,274  the  usable  responses  totaled 
1,203.    For  each  item,  the  response  rate  for  agree,  undecided,  and 
disagree  is  reported. 

Additional  analysis  examined  differences  between  physician  and 
nonphysician  responses  for  those  items  where  there  was  at  least  two 
responses  in  both  the  agree  and  disagree  categories.    The  analysis 
included  only  those  individuals  who  were  classified  as  either  a  PSRO 
staff  physician  or  physician  consultant  and  a  PSRO  staff  nonphysician, 
nonphysician  consultant  or  subcontractor  consultant.    Also  included 
were  only  those  individuals  who  were  rated  as  being  involved  in  all 
or  at  least  four  phases  of  demonstration  development. 

Analysis  of  Section  II  of  the  questionnaire  included  reading  the 
open-ended  responses  and  synthesizing  meaning  into  appropriate  cate- 
gories, depending  on  the  nature  of  the  question.    The  close-ended 
questions  in  Section  II  were  tallied  with  no  changes  in  the  response 
categories. 
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DISCUSSION  OF  SURVEY  FINDINGS  (SECTION  I) 

Presented  in  Table  2,  "Survey  Items  and  Responses:  Southcentral 
Pennsylvania  PSRO"  are  the  18  questions  along  with  the  total  responses 
per  question.    Thirteen  questionnaires  were  sent  to  the  PSRO  and  11 
were  returned.    The  total  responses  were  306,  20  of  which  were  not 
useable,  leaving  total  useable  responses  of  286. 

Respondents  agree  that  their  demonstration  project  is  a  research 
project  as  well  as  implementation  of  an  operational  review  system  (Item 
1  and  2).    They  also  believe  that  the  PSRO  should  place  little  reliance 
on  the  work  of  others  in  establishing  a  review  program  since  most  of 
their  concepts  were  self  generated  to  accommodate  the  unique  character- 
istics of  their  geographic  area  (Item  5).    There  was  agreement  that 
use  of  volunteer  physicians  participants  introduces  bias  into  research 
results  and  respondents  were  split  on  whether  volunteer  participants 
should  be  used  in  studies  of  ambulatory  care  quality  assurance  (Item  3). 

In  regards  to  project  goals,  respondents  unanimously  agreed  that 
the  purpose  of  a  PSRO  ambulatory  care  review  system  is  to  improve 
care  rendered  to  patients  as  well  as  to  help  contain  health  care  costs 
(Item  4).    There  was  some  disagreement  on  whether  a  review  program 
should  look  at  just  those  physician  practice  patterns  which  differ 
significantly  from  practice  norms  for  each  area  or  look  at  the  entire 
mainstream  of  care.    All  agreed  that  it  is  not  possible  to  say  whether 
ambulatory  care  programs  can  be  made  cost  effective  and  they  must 
consider  cost  effectiveness  if  the  PSRO  program  is  to  survive  (Items 
9  and  11).    Respondents  believe  that  review  topics  should  focus  on  those 
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areas  which  have  the  greatest  potential  for  improving  the  patients 
health  and  be  chosen  according  to  data  accessibility.    There  was  less 
agreement  on  whether  topics  are  best  determined  by  physician  members 
of  PSRO  peer  review  committees  (Item  12).    It  is  believed  that  non- 
physician  services  should  be  reviewed  in  the  future  however  it  may 
not  be  feasible  immediately  (Item  14).    Respondents  favor  criteria 
which  focus  on  over-  and  underutil ization  and  believe  that  the 
ultimate  goal  of  a  review  system  is  to  develop  standards  and  criteria, 
compare  practice  patterns  to  them,  and  then  encourage  compliance 
where  variations  exist  (Items  17  and  18).    Respondents  believed  that 
the  technical  assistance  provided  to  them  from  outside  their  PSRO 
served  their  needs  (Item  6). 

The  feasibility  issue  was  raised  in  several  questions.  Respond- 
ents believe  that  ambulatory  care  review  is  feasible,  however,  there 
is  disagreement  as  to  whether  it  could  be  implemented  on  a  nationwide 
basis.    In  particular,  they  believe  that  their  approach  is  acceptable 
to  physicians,  however,  are  split  on  whether  their  approach  could  be 
used  to  review  all  physicians  without  much  effort  and  modification 
of  arrangements  and  procedures  (Items  8,  13  and  15).    Some  respondents 
believe  that  more  research  is  needed  to  determine  the  best  approach 
to  changing  physician  practice  patterns,  some  that  it  is  best  to  pro- 
vide direct  feedback  to  each  practitioner  being  reviewed  and  one 
respondent  believes  that  feedback  is  most  effective  when  it  is  pro- 
vided to  groups  of  physicians  (Item  10). 

An  additional  analysis  was  conducted  on  those  questions  which 
showed  disagreement  among  respondents.    The  items  were  analyzed  where 
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either  two  or  more  respondents  appeared  to  disagree  (e.g.,  at  least 
two  or  more  responses  in  the  "agree"  category  and  at  least  two  or 
more  responses  in  the  "disagree"  category).    Analysis  was  conducted 
to  determine  whether  disagreement  may  have  occurred  dur  to  difference 
of  opinion  between  physicians  and  nonphysicians  who  had  been  heavily 
involved  in  the  entire  project.    Respondents  substantially  disagreed 
on  seven  items  (39%),  however,  analysis  did  not  clearly  indicate 
differences  between  the  physicians  and  nonphysicians. 
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TABLE  2.    SURVEY-  ITEMS  AND  RESPONSES: 


SOUTHCENTRAL  PENNSYLVANIA  PSRO 


Our  demonstration  is  a  research  project  wherein  data  collection 
will  assist  in  performing  subsequent  ambulatory  care  studies. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

6  0  0 

We  are  interested  only  in  the  development  of  an  operational 
ambulatory  care  review  system  for  improving  quality  of  care 
rendered  in  our  area. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

0  1  4 

Our  demonstration  is  a  combination  of  research  design  and 
implementation  of  an  operational  review  system.    We  believe 
one  must  conduct  adequate  front  end  investigation  prior  to 
implementation. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

6  1  1 

In  view  of  the  problems  in  measurement,  conducting  research  on 
ambulatory  care  is  unlikely  to  produce  meaningful  results. 

And 

The  prime  emphasis  of  any  PSRO  should  be  on  development  of  an 
operational  quality  assurance  project,  research  is  not  likely 
to  result  in  improved  patient  care  in  the  practice  settings. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

1  2  9 

A  PSRO  must  conduct  research  to  better  understand  the  problem 
before  an  operational  program  to  resolve  the  program  can  be 
implemented. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

5  0  2 
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a)  In  our  ambulatory  demonstration  project,  the  use  of  volunteer 
subjects  has  been  invaluable.  No  study  of  ambulatory  quality 
assurance  could  be  completed  without  voluntary  participants. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

3  0  3 

b)  Using  physicians  who  volunteer  their  office  data  is  a  practical 
solution  to  a  practical  problem  (obtaining  practice  data  from 

a  physician's  office).    In  most  instances,  there  is  no  other 
choice. 

TOTAL  RESPONSES  

Agree      Undecided  Disagree 

3  2  3 

c)  The  use  of  volunteers  introduces  a  bias  into  the  results  of 
any  study  which  limit  the  general izability  of  the  findings  to 
the  practices  studied  and  reduces  the  potential  for  using 
results  in  HSQB  policy  development. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

4  0  1 

The  purpose  of  a  well  constructed  PSRO  ambulatory  care  review  system 

a)  To  improve  the  care  rendered  to  all  patients  in  its  area. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

5  0  0 

b)  Change  physician  practice  patterns  which,  in  turn,  would 
impact  upon  the  care  rendered  to  patients  in  the  area. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

6  0  0 

c)  To  improve  the  quality  of  care  rendered  to  patients  in  the 
office  setting  as  well  as  to  help  contain  health  care  costs. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

7  0  0 
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In  conducting  an  ambulatory  care  quality  assurance  demon- 
stration, reliance  on  the  research  findings  of  others  is  use- 
ful but  not  mandatory. 

And 

PSROs  beginning  ambulatory  projects  should  place  little  reliance 
on  the  work  of  others  in  establishing  a  review  program,  most 
of  our  concepts  were  self  generated  to  accommodate  the  unique 
characteristics  of  our  geographic  area. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

7  1  1 

It  is  necessary  to  conduct  a  complete  literature  search  to 
review  the  findings  of  others  prior  to  starting  any  research 
or  demonstration  project. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

1  0  2 

Our  staff  resources  were  such  that  little  or  no  technical 
assistance  from  outside  the  PSRO  was  needed. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

1  0  3 

In  launching  an  ambulatory  care  demonstration  project  heavy 
emphasis  should  be  placed  upon  the  expertise  of  various  out- 
side consultants  for  the  first  two  years. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

2  3  1 

The  technical  assistance  provided  through  HSQB  and  HCMS  served 
all  of  our  technical  assistance  needs  during  the  demonstration. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

5  1  0 
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a)     The  amount  of  seriously  substandard  ambulatory  care  cannot 

accurately  be  assessed  based  upon  our  demonstration  experience 
thus  far.    It  is  too  soon  to  tell. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
7  1  1 


b)     Substandard  care  in  the  ambulatory  sector  is  pervasive  and  can 
be  found  to  a  greater  or  lesser  degree  in  most  office  practices. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
0  3  0 


c)     From  our  experience  thus  far  it  appears  that  the  degree  of 
substandard  ambulatory  care  is  fairly  low  reflecting  only  a 
small  percentage  of  physicians. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
1  3  0 


a)     Many  illnesses  treated  in  the  ambulatory  sector  are  ill 
defined,  self-limiting  conditions  for  which  there  are  no 
clearly  accepted  therapeutic  regimes.    As  such,  review  of 
ambulatory  care  is  not  feasible. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
0  1  3 


b)     Quality  assurance  in  ambulatory  care  is  no  different  than  any 
other  form  of  care,  it  exists  in  finite  amounts  and  those 
amounts  can  be  measured  just  the  same  as  inpatient  care  can 
be. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
0  3  0 


c)     From  our  experience  as  an  ambulatory  demonstration  site,  it 
seems  quite  feasible  to  implement  quality  assurance  programs 
for  ambulatory  care  on  a  nationwide  basis. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
2  1  3 
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9.  a)     An  ambulatory  quality  assurance  program  should  look  at  just 

those  physician  practice  patterns  which  differ  significantly 
from  practice  norms  for  each  area. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

2  2  1 

b)  An  ambulatory  quality  assurance  program  should  look  at  the 
entire  mainstream  of  care  and  seek  to  optimize  the  practices 
of  as  many  doctors  as  possible. 

TOTAL  RESPONSES  

Agree      Undecided  Disagree 

3  1  1 

c)  At  this  time,  it  is  not  possible  to  say  whether  ambulatory 
quality  assurance  programs  can  be  made  cost  effective  enough 
to  review  the  entire  spectrum  of  ambulatory  care. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

7  0  0 

10.  a)     Changing  practice  behavior  is  best  achieved  by  direct  practice 

pattern  feedback  to  each  practitioner  being  reviewed. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

4  3  0 

b)  Feedback  comparing  individual  practices  to  a  norm  or  standard 
results  in  physician  defensi veness  and  resistance.    The  best 
way  to  change  practice  behavior  is  through  education  and 
general  feedback  to  groups  of  physicians  without  individual 
comparisons. 

 TOTAL  RESPONSES  

Agree       Undecided  Disagree 

1  1  2 

c)  The  best  approach  to  changing  physician  practice  patterns  for 
purposes  of  quality  assurance  is  not  known  at  present,  more 
research  on  this  issue  must  be  undertaken. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

4  0  0 
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11.  a)     Cost  containment  and  quality  assurance  are  totally  mutually 

exclusive  and  cannot  be  dealt  with  simultaneously  in  ambu- 
latory quality  assurance  efforts. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

1  1  2 

b)  The  primary  purpose  of  a  PSRO  quality  assurance  project  is  to 
improve  patients  care  regardless  of  the  cost  implications. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

0  1  2 

c)  Ambulatory  quality  assurance  while  emphasizing  improved 
patient  outcomes  must  also  consider  cost  effectiveness  in 
patient  care  if  the  PSRO  program  is  to  survive. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

8  0  0 

12.  a)     Ambulatory  care  review  should  focus  on  those  topics  which  have 

the  greatest  potential  for  improving  the  patient's  health. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

4  0  1 

b)  Review  topics  in  ambulatory  care  must  be  chosen  according  to 
data  accessibility,  and  frequency  of  occurrence  in  the  primary 
setting. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

5  2  1 

c)  Review  topics  are  best  developed  by  focusing  on  specific 
practice  problems  determined  by  physician  members  of  PSRO  peer 
review  committees. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

3  1  2 
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13.  a)     The  approach  we  have  used  to  conduct  ambulatory  quality 

assurance  will  be  acceptable  and  feasible  in  conducting 
review  for  all  physicians. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

2  7  0 

b)  Our  demonstration  approach  is  quite  unique  and  unlikely  to  be 
duplicated  to  the  point  where  it  would  be  acceptable  to 
physicians  in  other  PSRO  areas. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

0  1  5 

c)  The  approach  we  used  in  conducting  ambulatory  quality  assur- 
ance has  been  largely  unacceptable  to  physicians. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

0  0  5 

14.  a)     The  integration  of  review  for  ambulatory  services  rendered  by 

nonphysicians  with  existing  PSRO  efforts  is  not  feasible  at 
this  time. 

 TOTAL  RESPONSES  

Agree      Undecided  Disagree 

1  2  1 

b)  As  the  trend  toward  whollistic  patient  care  increases,  the 
necessity  of  reviewing  nonphysician  treatment  will  become 
necessary  sometime  in  the  future. 

 TOTAL  RESPONSES  

Agree       Undecided  Disagree 

4  1  1 

c)  Incorporating  the  work  done  by  nonphysician  practitioners  into 
the  peer  review  process  is  quite  feasible  and  could  be  under- 
taken immediately. 

 TOTAL  RESPONSES  

Agree       Undecided  Disagree 

3  1  4 
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15.    a)     The  procedures  for  ambulatory  quality  assurance  developed  in 
our  demonstration  are  transferable  to  any  other  PSRO  without 
modification  or  special  arrangements. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
3  0  4 


b)     The  nature  of  our  demonstration  is  quite  unique  and  it  is 

unlikely  that  our  approach  could  ever  be  duplicated  in  another 
PSRO. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
0  0  5 


c)  Transferrence  of  our  ambulatory  quality  assurance  procedures 
to  other  PSROs  while  achievable  would  entail  much  effort  and 
very  probably  modification  of  arrangements  and  procedures. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
5  2  1 


16.  Problems  uncovered  in  practices  with  respect  to  one  review 

topic  are  often  associated  with  problems  in  other  topics. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
8  3  0 


17.  The  criteria  developed  for  each  review  topic  should  focus  upon 

over  and  underutilization  of  medical  services  simultaneously. 

TOTAL  RESPONSES 


Agree      Undecided  Disagree 
7  2  1 


18.  The  ultimate  goal  of  an  ambulatory  quality  assurance  review 

system  is  to  develop  standards  and  criteria,  compare  practice 
patterns  to  them  and  then  encourage  compliance  where  variations 
exist. 

TOTAL  RESPONSES  


Agree      Undecided  Disagree 
7  1  1 
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SECTION  IV 
QUANTITATIVE  PROGRAM  DESCRIPTORS 
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METHOD 

Requests  for  quantitative  descriptions  tailored  to  fit  the  specific 
programs  of  each  of  the  five  projects  were  sent  out  in  August  1978. 
Requested  data  involved  population  and  activity  items  for  the  sites 
under  study  by  the  projects  including  such  items  as  the  number  of 
hospitals,  clinics,  physicians,  patients  and  patient  visits  at  these 
sites.    Tabulations  were  requested  of  physicians  by  specialty  and 
patients  by  source  of  payment.    In  addition  quantitative  descriptors 
of  the  review  activities  wererequested.    These  included  numbers  of 
physicians  and  patients  reviewed  by  topic  and  the  number  of  patient 
visits  involved.    Finally,  distribution  of  the  variations  or  excep- 
tions to  review  criteria  were  requested  along  with  quantitative  descrip- 
tion of  the  feedback  and  intervention  function  of  the  project.  Other 
data  of  specific  significance  to  individual  projects  was  also  included 
in  the  requests. 

Quantitative  data  reports  submitted  by  the  projects  in  response 
to  these  requests  were  screened  by  HCMS  personnel  for  completeness 
and  consistency  and  follow  up  was  made  by  telephone  to  make  the  data 
as  valid  as  possible.    Some  requested  data  could  not  be  supplied  by 
the  project  because  it  was  not  available  at  the  sites  studied.  Only 
data  available  as  of  August  31,  1978  were  used  and  some  sites  were  in 
the  midst  of  the  review  cycle  at  that  time.    The  quantitative  data 
that  was  submitted  by  the  five  projects  was  formatted  by  HCMS  staff 
into  tabular  form  designed  to  be  as  consistent  as  possible  among  pro- 
jects but  still  displaying  the  unique  qualities  of  the  individual  project. 
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SITES  AND  PHYSICIANS  REVIEWED 

The  ten  ambulatory  sites  involved  in  the  study  were  served  by  a  total 
of  109  individual  physicians,  some  practicing  at  more  than  one  of  the  sites. 
Table  3  displays  the  distribution  of  physicians  among  sites  and  an  esti- 
mated monthly  rate  of  patient  visits  based  on  an  eight-month  estimate 
furnished  to  the  PSRO  by  the  sites.    The  three  hospital  based  practices, 
numbered  5,  6  and  9,  indicated  the  largest  number  of  participating  physi- 
cians but  generally  shared  individual  providers  with  the  other  sites, 
site  number  5  sharing  with  sites  1  and  3,  site  number  6  with  2,  4,  7  and 
10  and  site  9  with  2,  4,  7  and  8.    Thirty  one  of  the  physicians  practiced 
at  two  hospital  based  sites,  6  and  9.    No  estimates  of  patient  populations 
by  site  were  available  nor  was  any  attempt  made  to  determine  patient 
crossover  by  site. 

PATIENTS  AND  CASES  REVIEWED 

The  PSRO  developed  estimates  of  patients  at  the  10  sites  having 
diagnoses  associated  with  review  topics  as  of  the  beginning  of  the  study. 
This  data  is  presented  in  Table  4. 

Of  the  22,120  cases  which  might  have  been  considered  candidates  for 
review,  a  total  of  5,840  were  abstracted  for  the  study.    Table  5  shows 
the  distribution  of  cases  by  site  and  payment  source  and  Table  6  shows 
the  distribution  by  site  and  topic.    Individual  patients  are  identified 
across  topics  but  not  across  sites.    A  total  of  4,202  individual  patients 
were  involved  in  the  5,840  cases  abstracted. 

A  comprehensive  summary  of  review  activity  by  site  and  topic  was 
furnished  by  SCPPSR0.    This  summary  is  given  in  Table  7  and  shows  the 
duration  of  the  study  for  each  topic  and  the  total  patients  abstracted, 
total  patient  years  covered  by  the  data  and  total  number  of  visits  covered 
by  site  and  topic. 
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TABLE  3.    NUMBER  OF  PHYSICIANS  AND  ESTIMATED 
MONTHLY  PATIENT  VISIT  RATES  BY  SITE 


SITE 

NO.  OF 
PHYSICIANS 

ESTIMATED  PATIENT 
VISITS  PER  MONTH 

1 

2 

850 

2 

3 

540 

3 

4 

2,400 

4 

8 

4,000 

5 

40 

2,000 

6 

51 

1,375 

7 

8 

1 ,950 

8 

7 

4,500 

9 

44 

1 ,500 

10 

7 

790 

TOTAL 

174 

19,905 

INDIVIDUALS  109 
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TABLE  4.    NUMBER  OF  PATIENTS  AT  EACH  SITE  HAVING  DIAGNOSES 
ASSOCIATED  WITH  REVIEW  TOPICS  AS  OF  THE  BEGINNING  OF  THE  STUDY 


TOPIC 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

TOTAL 

1.  Diabetes 

57 

36 

161 

269 

134 

92 

131 

302 

100 

53 

1,336 

2.  Hypertension 

210 

134 

595 

991 

496 

340 

483 

1126 

372 

195 

4,942  - 

3.    Heart  Disease 

28 

18 

78 

127 

65 

45 

64 

147 

49 

26 

647 

4.  Anxiety/Depres- 
sion 

221 

141 

625 

1042 

521 

358 

508 

1172 

301 

205 

5,184 

5.  UTI 

60 

38 

169 

282 

141 

97 

137 

317 

106 

55 

1,402 

6.    Chest  Pain 

37 

24 

105 

176 

76 

60 

85 

193 

66 

35 

857 

7.  Arthritis 

62 

40 

177 

294 

146 

101 

143 

331 

110 

58 

1,462 

8.    Preventive  Care 
Adult 

269 

171 

758 

1264 

632 

435 

616 

1422 

474 

249 

6,290 

TOTAL 

944 

602 

2668 

4445 

2211 

1528 

2167 

6010 

1669 

876 

22,120 

TABLE  5.    NUMBER  OF  PATIENTS  ABSTRACTED  AT  EACH  SITE 
TABULATED  BY  PAYMENT  SOURCE 


SUE 


PAYMENT  SOURCE 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

TOTAL 

Medicare 

167 

38 

182 

298 

167 

82 

189 

235 

217 

135 

1,710 

Medicaid 

9 

0 

62 

26 

50 

217 

11 

11 

70 

15 

471 

Regular  Blue 
Shield 

145 

27 

247 

36 

349 

3 

15 

152 

2 

147 

1,123 

Mennonite  Relief 
Fund 

17 

24 

1 

328 

13 

8 

4 

8 

47 

2 

452 

Commercial  Insur- 
ance 

183 

39 

54 

89 

275 

1 

141 

202 

42 

100 

1,126 

No  Insurance 

2 

16 

96 

38 

40 

1 

17 

374* 

7 

591  . 

Information  Not 
Available 

70 

25 

20 

61 

20 

3 

94 

42 

12 

20 

367 

TOTAL 

592 

169 

662 

876 

914 

314 

455 

667 

764 

426 

5,840 

*   Site  9  does  not  maintain  complete  insurance  information  on  their  patients. 
Some  of  these  may  have  Blue  Shield  or  other  insurance. 
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TABLE  6.    NUMBER  OF  PATIENTS  REVIEWED  AT  EACH  SITE  DURING  STUDY 

TABULATED  BY  TOPIC 


SITE 


TOPIC 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

TOTAL 

1.  Diabetes 

46 

16 

64 

126 

90 

60 

96 

75 

81 

47 

701 

2.  Hypertension 

100 

22 

101 

101 

95 

73 

92 

100 

115 

98 

897 

3.  Heart  Disease 

49 

15 

58 

68 

101 

32 

52 

70 

50 

71 

566 

4.  Anxiety/ Depres- 
sion 

100 

23 

111 

131 

168 

79 

83 

101 

146 

62 

1 ,004 

5.  UTI 

60 

27 

95 

50 

132 

16 

27 

98 

99 

604 

6.  Chest  Pain 

51 

12 

85 

44 

97 

19 

19 

41 

94 

21 

483 

7.  Arthritis 

87 

18 

103 

73 

113 

29 

59 

80 

79 

92 

733 

8.  Preventive  Care- 
Adult 

100 

36 

45 

283 

118 

6 

27 

102 

100 

35 

852 

TOTAL 

593 

169 

662 

876 

914 

314 

455 

667 

764 

426 

5,840 

INDIVIDUALS 

335 

142 

458 

743 

676 

205 

370 

486 

491 

296 

4,202 
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TABLE  7.    NUMBER  OF  PATIENTS,  PATIENT  YEARS  AND  VISITS 
REVIEWED  AT  EACH  SITE  BY  TOPIC 


POTENTIAL 

SITE  1 

SITE  2 

SITE  3 

SITE  4 

TIME  PERIOD 

TOPIC 

COVERED  BY 
TOPIC 

PTS. 

PT  YRS. 

W  T  O  T  T  C 

VISITS 

nxc 

nT  VDC 

PI  YKo. 

\;  T  c  TTQ 
Viol  1 O 

DTQ 
r  1  J. 

DT  VD<^ 
r 1    I Ko . 

VT^TT^ 
viol i o 

r  1  ji 

PT  YRS 

VTSITS 

1 

Diabetes 

2  years 

46 

67 

709 

16 

7 

86 

64 

80 

1 ,005 

126 

214 

2,265 

2 

Hypertension 

2  years 

100 

148 

1  ,245 

on 
Id. 

b 

on 

i  m 

1  U  1 

in 
1 1 1 

i  find 

1  ,  out 

i  m 

1  U  1 

1  Ul 

1  672 

1     y  \J  /  Cm 

3 

Heart  Disease 

2  years 

49 

70 

667 

1  5 

9 

1  1  5 

CO 

bo 

pn 
ou 

end 

DO 

liq 

1  ?^ 

4 

Anxiety/ 
Depression 

2  years 

100 

154 

1,198 

23 

11 

149 

111 

148 

1,457 

131 

178 

2,387 

r 
0 

UTI 

4  months 

60 

5 

155 

27 

4 

96 

95 

13 

396 

50 

9 

194 

6 

P.  mn  n  1"  h  c 
O    I  HUM  Lf  lb 

41 

15 

240 

12 

1 

32 

85 

22 

426 

44 

18 

272 

7 

Arthritis 

2  years 

87 

120 

1,068 

18 

5 

98 

103 

135 

1 ,626 

73 

122 

1 ,160 

8 

Preventive 
Care-Adult 

8  months 

100 

27 

432 

36 

5 

119 

45 

5 

167 

283 

82 

834 

TABLE  7  (CONT'D) 


POTENTIAL 
TIME  PERIOD 

C  T  TT  c 

SITE  5 

SITE  6 

SITE  7 

SITE  8 

TOPIC 

COVERED  BY 
TOPIC 

PTS. 

PT  YRS. 

VISITS 

PTS. 

PT  YRS. 

VISITS 

PTS. 

PT  YRS. 

VISITS 

PTS. 

PT  YRS. 

VISi lb 

1 

ui aDe ues 

C    JfCOl  3 

90 

139 

1 ,039 

60 

96 

1 ,168 

96 

158 

1,528 

75 

115 

1,290 

2 

Hypertension 

2  years 

95 

143 

1,097 

73 

114 

1,172 

92 

155 

1,538 

100 

143 

1,469 

3 

Heart  Disease 

2  years 

101 

156 

1,140 

32 

53 

678 

52 

93 

992 

70 

96 

1,137 

4 

Anxiety/ 
Depression 

2  years 

168 

214 

1  "7/|r 

1 ,745 

79 

147 

1 ,354 

83 

137 

1,609 

101 

149 

2,132 

5 

1  ITT 
U  1  1 

1  32 

15 

352 

16 

2 

42 

27 

5 

143 

98 

13 

369 

6 

Chest  Pain 

8  months 

97 

26 

301 

19 

9 

100 

19 

8 

95 

41 

10 

150 

7 

Arthritis 

2  years 

113 

161 

1,049 

29 

41 

501 

59 

102 

1,285 

80 

114 

1,244 

8 

Preventive 
Care-Adult 

8  months 

118 

23 

294 

6 

2 

17 

27 

6 

74 

102 

23 

374 

TABLE  7  (CONT'D) 


DnTFMTTfll 

KU  1  LlN  1  IML 

^TTF  Q 

Jilt  V 

STTF 

J  1  1  L 

lo 

1  U  1  ML 

mo  Al  1 

rUK  HLL 

0  1  1  to 

TIME  PERIOD 

TOPIC 

COVERED  BY 

TOP  TP 

PTS. 

PT  YRS. 

VISITS 

PTS. 

PT  YRS. 

VISITS 

PTS. 

PT  YRS. 

VISITS 

1 

VI  dUc Leo 

Rl 

1  OS 

1  231 

47 

63 

424 

701 

1 ,044 

10,745 

2 

Hypertension 

2  years 

115 

145 

1,329 

98 

125 

763 

897 

1,252 

11 ,978 

3 

Heart  Disease 

2  years 

50 

70 

753 

71 

101 

629 

566 

847 

8,278 

4 

Anxiety/ 
Depression 

2  years 

1  *t  0 

997 
LCI 

9  m  n 

L  )  U  1  U 

406 

1  004 

1  438 

14,447 

5 

IITT 

U  1  1 

*T    IIIUM  Ul  1 0 

99 

13 

365 

604 

79 

2,112 

6 

Chest  Pain 

8  months 

94 

22 

400 

21 

4 

67 

473 

135 

2,083 

7 

Arthritis 

2  years 

79 

97 

913 

92 

103 

782 

733 

1,000 

9,726 

8 

Preventive 
Care-Adult 

8  months 

100 

19 

347 

35 

3 

50 

852 

195 

2,708 
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SECTION  V 
DISCUSSION  OF  REVIEW  DATA 
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METHOD 

A  five  percent  random  sample  of  abstracts  was  requested  from 
the  project.    This  sample  was  to  be  selected  by  topic  and  site  with  no 
fewer  than  five  cases  for  any  topic  for  any  site.    This  procedure 
resulted  in  a  1%  sample.    The  data  was  used  to  estimate  the  data  avail- 
ability rate,  defined  as  the  number  of  cases  for  which  a  particular 
data  item  was  noted  in  the  abstract  at  least  once  divided  by  the  total 
number  of  cases,  shown  in  percentage  form.    Of  interest  was  a  comparison 
of  the  availability  rates  of  data  items  involved  in  the  "critical 
criteria"  as  defined  by  the  project  with  rates  for  data  items  not 
involved  in  the  critical  criteria. 

"Variations"  were  defined  as  a  failure  to  meet  one  of  the  critical 
criteria.    Some  of  the  variations  noted  were  referred  to  the  sites 
and  studied  for  possible  justification.    Variations  not  so  justified 
were  called  "deficiencies."    Variation  and  deficiency  rates  were 
expressed  as  percentage  deviations  from  full  compliance  and  these  rates 
were  submitted  by  the  project  for  the  entire  population  studied. 

DESCRIPTION  OF  CRITERIA/DATA  ITEMS 

Table  8  lists  abstracted  data  items  associated  with  critical 
criteria  for  each  of  the  eight  topics  studied.    Organization  is  by  topic 
for  which  are  shown: 

1.  Number  of  cases  studied 

2.  Number  of  cases  in  the  HCMS  sample 

3.  Mean  years  of  care  for  patients  in  the  sample 

4.  Mean  visits  per  year  for  those  patients 
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Critical  criteria  are  listed  for  each  topic  and  each  criteria  is 
classified  according  to  the  following  scheme: 

CODE  CLASS 

DR  Required  Diagnostic  Process 

DP  Prohibited  Diagnostic  Process 

DC  Conditional  Diagnostic  Process 

TR  Required  Treatment  Process 

TP  Prohibited  Treatment  Process 

TC  Conditional  Treatment  Process 

OV  Outcome  Indicator  Based  on  Values  (LAB) 

OU  Outcome  Indicator  Involving  Overutil ization 

OE  Outcome  Indicator  Involving  Occurrence  of  Events 

Critical  criteria  classifications  are  summarized  in  the  following 
table: 

REQUIRED           PROHIBITED       CONDITIONAL  TOTAL 
 (VALUES)  (EVENTS)  

DIAGNOSES  18  2  20 

TREATMENT  6  3  i0  19 

OUTCOMES  3  1  3  7 


TOTAL  27  4  15  46 

Note  that  we  might  expect  failure  to  meet  DR,  TR  and  OV  criteria  in 
cases  of  underutil ization  and  DP,  TP  and  OU  in  cases  of  overutil ization. 
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Variation  percents  are  also  listed  for  each  critical  criteria.  These 
rates  are  for  the  whole  population  and  were  taken  from  the  data  displays 
prepared  by  the  PSRO  for  feedback  to  the  sites. 

Data  items  associated  with  critical  criteria  are  then  listed  along  with 
the  data  processing  code,  form  required,  number  and  percent  of  patients  in  the  HCMS 
sample  for  which  data  entries  were  made,  and  total  number  of  procedures  and 
utilization  rates  in  the  sample.    Data  items  recorded  in  the  abstracts  but 
not  related  to  critical  criteria  are  listed  at  the  end  of  each  topic  section. 
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TABLE  8.    CRITERIA/DATA  ITEMS 


1.    DIABETES  MELLITUS       Cases:  701  Mean  Years:  1.45 

Sample  Size:    51  Visits  Per  Patient  Year:  11.7 

A.    Fasting  Blood  Sugar  results  less  than  200  mg%  (FBS  200  mg%  and/or  Random 

or  4_  Hour  Post  Prandial  Blood  Sugar  results  less  than  250  mg%  (RBS/4  hr 

pp  250  mg%)  -  In  order  to  meet  this  criterion,  no  random,  fasting  or  4  hr 

pp  blood  sugar  results  may  exceed  the  indicated  value  (200  and  250  mg%) 

at  any  time  following  the  data  of  diagnosis  during  the  study  period. 

NOTE:    If  no  fasting,  random  or  4  hr  post  prandial  blood  sugars  are 

performed  during  the  study  period  or  following  the  date  of 

diagnosis,  the  criterion  is  recorded  as  not  met. 
VARIATION  RATE:    51%         CLASS  OV 


SAMPLE  DATA  RATES 


DATA  ITEMS 

REQ 

NO.  PATIENTS 

%  NO. 

PROCEDURES 

PER 
VISIT 

PER 
PAT. 

017  4  Hr  pp  Blood  Glucose 

Values 

5 

10 

18 

.02 

.2 

029  Fasting  Blood  Sugar 

Values 

42 

82 

182 

.21 

2.5 

031  Random  Blood  Sugar 

Values 

39 

76 

189 

.22 

2.6 

B.    Three  visits  per  year  -  One  patient  visit  every  120  days.    In  order  to  meet 
this  criterion,  there  must  be  at  least  one  patient  visit  during  every  120 
day  period  beginning  at  the  date  of  diagnosis  or  the  first  visit  during  the 
study  period  for  those  patients  diagnosed  prior  to  the  study  period. 

> 

VARIATION  RATE:    36%         CLASS  DR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ     NO.  PATIENTS     %     NO.  PROCEDURES    VISIT  PAT.  YR. 

600  Visits  Dates  51  100        863  1.00  11.7 
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TABLE  8  (CONT'D) 

C.    Weight  loss  -  In  order  to  meet  this  criterion,  no  two  consecutive  weights 
at  any  time  during  the  study  period  can  be  equal  to  or  greater  than  the 
weight  on  the  diagnosis  date.    For  patients  diagnosed  prior  to  the  two- 
year  period,  the  criterion  applies  to  all  recorded  weights.    The  criterion 
is  not  met  when  the  patient  gains  weight  and  is  overweight.    However,  a 
patient  who  gains  weight  but  who  is  not  overweight  is  considered  to  have 
met  the  criterion  by  exception. 
VARIATION  RATE:    23%  CLASS  OV 

SAMPLE  DATA  RATES 


PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

002  Weight  Values  51  100  653  .76  8.9 


D.    Diet  therapy  before  oral  hypoglycemics  -  In  order  to  meet  the  criterion 
there  must  be  evidence  that  a  patient  who  is  diagnosed  as  having  diabetes 
within  the  two-year  study  period  receives  diet  therapy  before  oral  hypo- 
glycemics are  prescribed. 
VARIATION  RATE:    3%  CLASS  TC 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

701  Patient  Ed.  Diet  Sequence        40  78  205  .24  2.8 

109  Insulin  Oral  Hypog.      Sequence       41  80  468  .54  6.3 

No  hospitalization  -  In  order  to  meet  this  criterion,  there  must  be  no 
evidence  of  inpatient  hospitalization  throughout  the  two-year  study  period. 
Any  hospitalization  of  a  patient  diagnosed  prior  to  the  study  period  will 
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TABLE  8  (CONT'D) 


result  in  a  variation. 

For  patients  diagnosed  within  the  study  period, 

the 

criterion  applies  after  the  second  visit,  regarding  the  diagnosis  date  as 

nf    f  ho    *Fl  V*C  "h    V/1  C  1  t 
UT    Uilc    1  1  r  b  L    V  1  b  1  L- . 

VARIATION  RATE:  26% 

CLASS  0U 

• 

SAMPLE  DATA 

RATES 

DATA  ITEMS 

RE0 

NO.  PATIENTS     %  NO. 

PROCEDURES 

PER 
VISIT 

PER- 
PAT.  YR 

802  Hospitalization 

Absence           9  18 

11 

.01 

0.2 

F.    Other  Criteria 

SAMPLE  DATA 

RATES 

DATA  TTFM^ 

REQ 

NO    PATIENTS      %  NO. 

PROCEDURES 

PER 
VISIT 

PER 
PAT.  YR 

DDI  Heiaht 

UU  1     1  IC  l  Mil  l« 

Val  ue 

22  43 

NA 

NA 

NA 

nn^  Sv^toiic  bp 

UUU     *^Jr  j  wv  1    1  v#  U\ 

Val  up 

51  100 

sj  1                                1  uu 

648 

.75 

8.8 

Odd  Di  a«;t(il  i  r  BP 

Val  up 
vol  Uc 

51  inn 

u  1                           1  uu 

648 

.75 

8.8 

uu j  up 1 1  u  ruiiui  L.ACMH 

Done 

25  49 

47 

.05 

0.6 

nnfi  FkT>  nnnp 

UUD    Li\U  UUilc 

Done 

17  33 

24 

.03 

0.3 

uiu  uricbt  a- Kay  uuric 

Done 

16  31 

24 

.03 

0.3 

uiy  biucose  tolerance  uone 

Done 

1  2 

1 
i 

.00 

0.0 

nOI    BUM  nnno 

\}l  i  duin  uone 

Done 

22  43 

0/ 

.04 

0.5 

ucc  oerum  ureauine  uone 

Done 

15  29 

1  Q 

.02 

0.3 

024  Serum  Cholesteral  Done 

Done 

17  33 

23 

.03 

0.3 

025  Triglycerides  Done 

Done 

11  22 

16 

.02 

0.2 

026  Urinalysis  Done 

Done 

34  67 

86 

.10 

1.? 

027  CBC  Done 

Done 

20  39 

40 

.05 

0.5 

030  2  Hr  pp  Blood  Sugar 

Value 

16  31 

22 

.03 

0.3 

048  Visual  Accuity  Noted 

Done 

24  47 

57 

.07 

0.8 
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TABLE  8  (CONT'D) 
(Other  Criteria  Cont'd) 

049  Heart  Exam 

066  Impotence  Noted 

067  Perif.  Vase.  Noted 

068  Obesity  Noted 

069  Neuro  Exam 

090  Screening  Panels 
650  Telephone  Call 
655  House  Call 

800  Revisit 

801  Consult 
804  Other  Hosp. 
707  Other  Pat.  Ed. 


Done 

40 

78 

169 

.20 

2.3 

Dnrip 

2 

4 

2 

.00 

0.0 

Done 

21 

41 

60 

.07 

0.7 

Dnnp 

24 

47 

312 

.36 

4.2 

Donp 

20 

39 

39 

.05 

0.5 

Done 

17 

33 

25 

.03 

0.3 

Done 

24 

47 

122 

.14 

1 .6 

Done 

5 

10 

5 

.01 

0.7 

Done 

50 

98 

421 

.49 

5.7 

Done 

14 

27 

30 

.03 

0.4 

Done 

27 

53 

46 

.05 

0.6 

Done 

23 

45 

52 

.06 

0.7 
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TABLE  8  (CONT'D) 

2.    HYPERTENSION  Cases:  897      Mean  Pt  Years:  1.37 

Sample  Size:    50      Mean  Visits  Per  Pat.  Year:  8.6 

A.  Blood  Pressure  -  The  patients'  blood  pressures  are  reviewed  beginning 
two  months  after  the  problem  was  identified  by  the  practice.    In  order  to 
meet  the  criterion,  all  groupings  of  two  consecutive  readings  must  include 
one  diastolic  blood  pressure  of  90  mm  Hg.  or  less. 

VARIATION  RATE:    38%  CLASS  OV 

 SAMPLE  DATA  RATES 

PER  PTE- 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

004  Diastolic  BP  Value  50  100         539  .92  7.9 

B.  Visits  -  One  visit  each  120  days.    In  order  to  meet  this  criterion,  there 
must  be  a  patient  visit  at  least  once  during  each  120-day  period  following 
the  date  the  problem  of  hypertension  was  identified  by  the  practice. 
VARIATION  RATE:    42%  CLASS  TR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

600  Three  visits  per  year     Dates  50  100         586  1.00  8.6 


C.    Fundoscopic  Exam  -  In  order  to  meet  the  criterion,  a  fundoscopic  examination 
must  be  performed  at  least  once  during  the  two-year  study  period. 
VARIATION  RATE:    47%  CLASS  DR 

SAMPLE  DATA  RATES 


PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

005  Fundi scopic  Exam  Done  27  54  39  .07  0.6 
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TABLE  8  (CONT'D) 

D.    Drugs  -  In  order  to  meet  the  criterion,  the  patient  must  have  a  diuretic 
or  Propanolol  prescribed  before  or  concurrently  with  the  prescription 
of  any  specific  antihypertensive  drug. 
VARIATION  RATE:    5%  CLASS  TC 


SAMPLE  DATA 


RATES 


DATA  ITEMS 

REQ  NO. 

PATIENTS 

%  NO. 

PROCEDURES 

PER 
VISIT 

PER 
PAT.  YR 

101  Diuretic 

Sequence 

48 

96 

368 

.80 

5.4 

102  Propranolol 

Sequence 

9 

18 

74 

.13 

0.7 

103  Other  Spec.  Hyper. 

Sequence 

37 

74 

287 

.49 

4.2 

E.    Urinalysis  -  In  order  to  meet  the  criterion,  a  urinalysis  must  be  performed 
at  least  once  during  the  two  year  study  period. 
VARIATION  RATE:    30%  CLASS  DR 


DATA  ITEMS 


026  Urinalysis 


SAMPLE  DATA 


RATES 


REQ  NO.  PATIENTS 
Done  37 


PER  PER 
%    NO.  PROCEDURES    VISIT    PAT.  YR 


74 


69 


.12 


1.0 


F.    Serum  Potassium  -  In  order  to  meet  the  criterion,  a  serum  potassium  must 
be  performed  at  least  once  during  the  two-year  study  period  -  only  on 
those  patients  who  were  on  diuretics. 
VARIATION  RATE:    42%  CLASS  DR 


DATA  ITEMS 

101  Diuretics 

020  Serum  Potassium 


SAMPLE  DATA 


RATES 


PER  PER 

REQ       NO.  PATIENTS      %    NO.  PROCEDURES    VISIT    PAT.  YR. 


Sequence 
Sequence 


48 
26 


96 
52 


368 
57 


.63 
.10 


5.4 
0.8 
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TABLE  8  (CONT'D) 
G.    Other  Criteria 


SAMPLE  DATA  RATES 


DATA  ITEMS 

REQ 

NO.  PATIENTS 

%  NO. 

PROCEDURES 

PER 
VISIT 

PER 
PAT.  Y 

002  Weight 

Value 

50 

100 

466 

.80 

6.8 

003  Systolic  BP 

Value 

50 

100 

539 

.92 

7.9 

006  EKG* 

Done 

17 

34 

26 

.04 

0.4 

010  Chest  X-Ray 

Done 

16 

32 

14 

.02 

0.2 

021  BUN 

Value 

36 

72 

70 

.12 

1.0 

022  Serum  Creatine 

Value 

19 

38 

42 

.07 

0.6 

023  Serum  Uric  Acid 

Value 

38 

76 

62 

.11 

0.9 

024  Serum  Cholestrol 

Value 

33 

66 

46 

.08 

0.7 

025  Triglycerides 

Value 

20 

40 

24 

.04 

0.4 

027  CBC 

Value 

34 

68 

56 

.10 

0.8 

029  Fasting  Blood  Sugar 

Value 

17 

34 

36 

.06 

0.5 

030  2  PC  Blood  Sugar 

Value 

3 

6 

3 

.01 

0.0 

031  Random  Blood  Sugar 

Value 

36 

72 

73 

.12 

1.1 

032  Plasma  Renin 

Done 

1 

2 

1 

.00 

0.0 

033  Urinary  Catacham 

Done 

0 

0 

0 

.00 

0.0 

034  URN/PI asma  Aldst 

Done 

0 

0 

0 

.00 

0.0 

035  URN/PI asma  Corts 

Done 

0 

0 

0 

.00 

0.0 

036  Intraven/Pyelogram 

Done 

3 

6 

2 

.00 

0.0 

037  Renal  Artgram 

Done 

0 

0 

0 

.00 

0.0 

THERAPEUTICS 

104  Oral  Contra-Estr. 

Done 

2 

4 

10 

.02 

0.1 

105  Potassium  Suppl 

Done 

6 

12 

25 

.04 

0.4 

106  Digitalis 

Done 

4 

8 

24 

.04 

0.4 

107  Ataprct/Tranq 

Done 

19 

38 

86 

.15 

1 .3 

*Added  to  critical  criteria  as  result  of  review 

process , 

CLASS  DR. 
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TABLE  8  (CONT'D) 
(OTHER  CRITERIA  CONT'D) 


108  Sedatives 

Done 

9 

18 

41 

.07 

0.6 

701  Diet  Instr. 

Done 

22 

44 

70 

.12 

1.0 

702  Salt  Restriction 

Done 

9 

18 

18 

.03 

0.3 

800  Revisit 

Done 

48 

96 

337 

.58 

4.9 

801  Consultant 

Done 

13 

26 

18 

.03 

0.3 

802  Hospital 

Done 

7 

14 

7 

.01 

0.1 

803  Other  Disposition 

Done 

18 

36 

39 

.05 

0.4 

650  Telephone 

Done 

16 

32 

35 

.06 

0.5 

655  House  Call 

Done 

2 

4 

10 

.02 

0.1 
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TABLES  (CONT'D) 

3.    ISCHEMIC  HEART  DISEASE         Cases:  566        Mean  Patient  Years       :  1.45 

Sample  Size:     50        Visits  Per  Patient  Yr  :  10.6 

A.  Smoking  History  Documented  -  (100%)  -  In  order  to  meet  this  criterion, 
there  must  be  documented  evidence  in  the  medical  record  of  the  patients 
history  of  smoking.    If  there  was  no  documentation  of  smoking  history, 

■ 

the  case  does  not  meet  (varies  from)  the  criterion. 
VARIATION  RATE:    65%  CLASS  DR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

056  Smoking  History  Done  19  38  27  .04  0.4 

B.  Smoking  Patient  Education  -  (100%)  -  In  order  to  meet  this  criterion, 
there  must  be  documented  evidence  in  the  medical  record  that  patients 
who  smoke  received  patient  education.    If  there  was  no  smoking  history 
documented  the  criterion  is  not  met. 

VARIATION  RATE:    76%  CLASS  TC 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

056  Smoking  History  Sequence         19  38  27  .04  0.4 

103  Patient  Smoking  Ed.       Sequence  3  6  6  .01  0.1 

C.  EKG  Done  -  (100%)  -  In  order  to  meet  this  criterion,  there  must  be 
at  least  one  EKG  reported  within  the  study  period. 

VARIATION  RATE:    32%  CLASS  DR 

♦ 

 SAMPLE  DATA  RATES 

~  PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 


006  EKG  Done  31  62  52  .07  0.7 
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TABLE  8  (CONT'D) 

D.  No  Myocardial  Infarction  (0%)  -  In  order  to  meet  this  criterion,  the 
patient  should  not  have  had  a  myocardial  infarction  at  any  time  following 
the  diagnosis  date. 

VARIATION  RATE:    7%  CLASS  OE 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

303  MI  Absent  5  10  5  .01  0.1 

E.  No  Cardiac  Death  (0%)  -  In  order  to  meet  this  criterion,  deaths  during 
the  study  period  must  be  for  other  than  cardiac  reasons.    If  the  death 
was  due  to  cardiac  reasons  or  if  no  cause  of  death  was  specified  in  the 
medical  record,  the  case  did  not  meet  the  criterion. 

VARIATION  RATE:    3%  CLASS  OE 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS      %    NO.  PROCEDURES    VISIT    PAT.  YR. 

304  Ml/Death  Absent  1  2  1  .00  0.0 

F.  Visit  Every  120  Days  -  In  order  to  meet  this  criterion,  the  patient  must 
visit  the  physician  at  least  once  during  every  120-day  period  following 
diagnosis. 

VARIATION  RATE:    31%  CLASS  TR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

600  Visit  Every  120  Days     Dates  50  100  764  1.00  10.6 
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TABLE  8  (CONT'D) 
G.    Other  Criteria 


SAMPLE  DATA  RATES 


DATA  ITEMS 

REQ 

NO.  PATIENTS 

%  NO. 

PROCEDURES 

PER 
VISIT 

PER 
PAT.  YR 

002  Weight 

Value 

50 

100 

557 

.73 

7.7 

003  Systolic  BP 

Value 

50 

100 

616 

.81 

8.5 

004  Diastolic  BP 

Value 

50 

100 

616 

.81 

8.5 

010  Chest  X-Ray 

Done 

27 

54 

38 

.05 

0.5  * 

013  Ex  EKG 

Done 

6 

12 

6 

.01 

0.1 

024  Serum  Cholestrol 

Value 

28 

56 

38 

.05 

0.5 

025  Triglycerides 

Value 

18 

36 

27 

.04 

0.4 

026  Urinalysis 

Value 

29 

58 

91 

.12 

1.3 

053  Family  History 

Done 

26 

52 

29 

.04 

0.4 

065  Occup.  History 

Done 

16 

32 

20 

.03 

0.3 

076  Past  History 

Done 

25 

50 

37 

.05 

0.5 

078  Chest  Pain  Doc. 

Done 

33 

66 

116 

.15 

1.6 

095  Exercise  History 

Done 

16 

30 

36 

.05 

0.5 

101  Diuretic 

Done 

42 

84 

361 

.47 

5.0 

102  Propranil 

Done 

12 

24 

94 

.12 

1.3 

106  Digitalis 

Done 

27 

54 

243 

.32 

3.4 

127  Vasodilators 

Done 

26 

52 

175 

.23 

2.4 

140  Cardiac  Suppl . 

Done 

0 

0 

0 

.00 

0.0 

701  Diet  Ed. 

Done 

20 

40 

66 

.09 

0.9 

706  Exercise  Ed. 

Done 

12 

24 

29 

.04 

0.4 

800  Revisit 

Done 

45 

90 

368 

.48 

5.1  ' 

801  Consult 

Done 

9 

18 

15 

.02 

0.2  . 

802  Hosp/Cardiac 

Done 

14 

28 

18 

.02 

0.2 

803  Other 

Done 

21 

42 

36 

.05 

0.5 

804  Hosp/Noncardiac 

Done 

16 

32 

19 

.02 

0.3 

806  Other  M/S 

Done 

17 

34 

25 

.03 

0.3 
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TABLE  8  (CONT'D) 

4.    ANXIETY/DEPRESSION         Cases:  1004        Mean  Patient  Years         :  1.40 

Sample  Size:       58        Visits  Per  Patient  Year  :  12.4 

A.    Criterion  1:    Psychotherapy  or  Counselling  -  In  order  to  meet  this  criterion, 
psychotherapy  or  counselling  must  occur  anytime  during  the  study  period. 
VARIATION  RATE:    45%  CLASS  TR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

708  Counselling  or  Psycho     Done  34  59  175  .17  2.2 


B.    Criterion  2  -  No  Sedatives  are  prescribed  when  there  is  mention  of  depression  - 
In  order  to  meet  this  criterion,  a  sedative  may  not  be  prescribed  for  a 
patient  on  any  date  (visit)  that  depression  is  also  noted. 
VARIATION  RATE:    4%  CLASS  TP 

SAMPLE  DATA  RATES 


PER  PER 

DATA  ITEMS                             REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT  PAT.  YR. 

202  Mention  Depression       Sequence          40          69          137            .14  1.7 

108  Sedative                      Sequence           13          22            69            .07  0.9 

C.    Criterion  3  -  Follow-up  is  documented  at  each  visit  for  the  problem  - 
In  order  to  meet  this  criterion,  each  time  anxiety  or  depression  is 
mentioned  at  a  visit,  there  must  be  documented  evidence  that  some  plans 
for  follow-up  were  made.    Plans  for  follow-up  include  a  specified 
reappointment  interval,  referral  for  psychiatric  consultation,  admission 
to  a  hospital  or  other  facility  for  psychiatric  reasons  or  other  referrals 
for  emotional  reasons. 
VARIATION  RATE:    66%  CLASS  TR 
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SAMPLE  DATA 


RATES 


DATA  ITEMS 

REQ  NO. 

PATIENTS 

%  NO. 

PROCEDURES 

PER 
VISIT 

PER 
PAT.  YR 

201  Mention  Anxiety 

Sequence 

55 

95 

1 97 

.20 

2.4 

202  Mention  Depression 

Sequence 

40 

69 

137 

.14 

1.7 

800  Reappointment 

Sequence 

55 

95 

550 

.55 

6.8  . 

801  Other  Follow-up 

Sequence 

10 

17 

23 

.02 

0.3 

D.    Criterion  4  -  No  suicide  attempts  or  successes  -  In  order  to  meet  this 
criterion,  there  must  be  no  evidence  of  successful  or  unsuccessful 
suicide  by  the  patient  from  the  time  the  diagnosis  was  made  and  the 
practice  began  treating  the  problem. 


VARIATION  RATE:  2% 


CLASS  0E 


DATA  ITEMS 

301  Suicide  Attempt 

302  Suicide  Success 


REQ 


Absent 
Absent 


SAMPLE  DATA 


RATES 


PER  PER 

NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 


2 
0 


3 
0 


2 
0 


.00 
.00 


0.0 
0.0 


Other  Criteria 


DATA  ITEMS 


REQ 


SAMPLE  DATA 


RATES 


NO.  PATIENTS 


PER  PER 
%    NO.  PROCEDURES    VISIT    PAT.  YR. 


003  Systolic  BP 

Value 

58 

100 

706 

.70 

8.7 

004  Diastolic  BP 

Value 

58 

100 

706 

.70 

8.7 

027  Compl.  BC  Ordered 

Done 

30 

52 

42 

.04 

0.5 

073  History  of  Suicide 

Done 

4 

7 

4 

.00 

0.0 

074  T-4  Ordered 

Done 

18 

31 

26 

.03 

0.3 

090  Screening  Panel 

Done 

21 

36 

24 

.02 

0.3 

107  Ataract/Tranq 

Done 

48 

83 

392 

.39 

4.8 
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TABLE  8  (CONT'D) 
5.  UTI 


Cases:  607 
Sample  Size:  48 


Mean  Patient  Years:  0.17 
Visits  Per  Patient  Year:  21.4 


Criterion  1  -  History  of  Urinary  Tract  Infection  -  In  order  to  meet  this 
criterion,  there  must  be  a  documented  past  medical  history  of  urinary 
tract  infections  in  the  record. 
VARIATION  RATE:    58%  CLASS  DR 


DATA  ITEMS 

076  Past  Hx  UTI 

091  Recurrent  UTI 


SAMPLE  DATA 


RATES 


REQ  NO.  PATIENTS 
Done  1 9 

Done  2 


PER  PER 
%    NO.  PROCEDURES    VISIT    PAT.  YR, 


40 
4 


23 
2 


.13 
.01 


2.9 
0.2 


B.     Criterion  2  -  Urinalysis  Precedes  Treatment  -  This  criterion  applies 
only  to  those  patients  who  received  antibiotics,  sulfonomides  or  other 
anti -infective  agents.    In  order  to  meet  the  criterion,  a  urinalysis 
must  be  ordered  or  done  before  or  at  the  same  visit  that  treatment  was 
initiated  (drugs  ordered). 
VARIATION  RATE:    11%  CLASS  DC 


DATA  ITEMS 


SAMPLE  DATA 


RATES 


REQ 


PER  PER 

NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 


085  Urinalysis 

124  Antibiotics 

125  Sulfonomides 

126  Anti -Infective  Agents  Sequence 


Sequence 

44 

92 

85 

.50 

10.6 

Sequence 

20 

42 

40 

.23 

5.0 

Sequence 

24 

50 

28 

.16 

3.5 

Sequence 

8 

17 

14 

.08 

1.8 

C.     Criterion  3  -  Follow-up  -  In  order  to  meet  this  criterion,  definite 
follow-up  of  the  patient  must  be  specified  on  the  date  the  urinary 
tract  infection  was  diagnosed.    Follow-up  includes  specific  reappoint- 
ment or  referral  or  hospitalization  for  the  problem. 

VARIATION  RATE:    36%  CLASS  TR 
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TABLE  8  (CONT'D) 


SAMPLE  DATA   RATES 


nflTfl  TTCMC 
UM  1  M   11  trio 

REQ  NO. 

r\  at*  t  piiTr 

PATIENTS 

%  NO. 

PROCEDURES 

VISIT 

PAT. 

205  Diagnosis 

Sequence 

39 

81 

60 

.35 

7.5 

800  Revisit 

Sequence 

38 

79 

89 

.52 

11.1 

801  Consult 

Sequence 

6 

13 

10 

.06 

1.3 

802  Hospital 

Sequence 

2 

4 

3 

.02 

0.4 

D.     Criterion  4  -  Follow-up  Urine  Culture  -  This  criterion  applies  only  to 
those  patients  for  whom  drugs  were  prescribed  (antibiotics,  sulfonamides 
or  other  anti-infective  drugs).    In  order  to  meet  the  criterion,  a  urine 
culture,  gram  stain  or  urine  screen  must  be  ordered  or  done  three  weeks 
or  more  after  treatment  is  begun  (drugs  prescribed). 
VARIATION  RATE:    76%  CLASS  DC 


SAMPLE  DATA   RATES 


DATA  ITEMS 

REQ  NO. 

PATIENTS 

%  NO. 

PROCEDURES 

PER 
VISIT 

PER 
PAT. 

086  Urine  Culture 

Sequence 

11 

23 

11 

.06 

1.4 

087  Gram  Stain 

Sequence 

8 

17 

9 

.05 

1.1 

088  Urine  Screen 

Sequence 

17 

35 

20 

.12 

2.5 

124  Antibiotics 

Sequence 

20 

42 

40 

.23 

5.0 

125  Sulfonamides 

Sequence 

24 

50 

28 

.16 

3.5 

126  Anti-Infectives 

Sequence 

8 

17 

14 

.08 

1.8 

E.     Criterion  5  -  Treatment  -  This  criterion  applies  only  to  those  patients 

who  had  positive  urine  cultures  or  screens.    In  order  to  meet  this 

criterion,  treatment  (indicated  drugs  prescribed)  must  occur  concurrent 

with  or  at  any  time  subsequent  to  all  positive  urine  cultures  or  screens. 

VARIATION  RATE:    8%  CLASS  TC 

Same  data  elements  as  D.  Criterion  4— different  sequence  required. 
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TABLE  8 (CONT'D) 
F.     Other  Criteria 


DATA  ITEMS 

011  Void  Cystogram 

511  Void  Cystogram 

012  Retro.  Peylogram 

512  Retro.  Peylogram 
036  IVP 

536  IVP 

089  Cystoscopy 

589  Cystoscopy 

160  Tx  Cont.  Past  2  Mo. 

401  Difficult  Urination 

402  Frequency 

403  Urgency 

404  Burning 

405  Pain 

406  Blood  in  Urine 

590  Sensitivity 

592  RBC 

593  WBC 

594  Bacteria 

803  Other  Dispos 

804  Other  Hosp. 
806  Other  Consult 


SAMPLE  DATA  RATES 

PER  PER 


REQ 

NO.  PATIENTS 

%  NO. 

PROCEDURES 

VISIT 

PAT. 

Order 

0 

0 

0 

.00 

0.0 

Value 

1 

2 

1 

.01 

0.1 

Order 

0 

0 

0 

.00 

0.0 

Value 

0 

0 

0 

.00 

0.0 

Order 

3 

6 

3 

.02 

0.4 

Value 

7 

15 

7 

.04 

0.9 

Order 

0 

0 

0 

.00 

0.0 

Value 

2 

4 

2 

.01 

0.2 

Value 

7 

15 

7 

.04 

0.9 

Value 

17 

35 

19 

.11 

2.4 

Value 

24 

50 

29 

.17 

3.6 

Value 

17 

35 

19 

.11 

2.4 

Value 

18 

38 

18 

.11 

2.3 

Value 

6 

13 

7 

.04 

0.9 

Value 

5 

10 

5 

.03 

0.6 

Value 

10 

21 

12 

.07 

1.5 

Value 

45 

94 

84 

.49 

10.5 

Value 

45 

94 

84 

.49 

10.5 

Value 

45 

94 

83 

.49 

10.4 

Done 

18 

38 

24 

.14 

3.0 

Done 

2 

4 

2 

.01 

0.2 

Done 

1 

2 

1 

.01 

0.1 
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TABLES  (CONT'D) 

6.    CHEST  PAIN  Cases:         483  Mean  Patient  Years:  0.35 

Sample  Size:  50  Visits  per  Patient  Year: 13. 7 

A.  Criterion  1  -  Past  Medical  History  -  In  order  to  meet  this  criterion, 

the  patient's  medical  history  must  be  documented  within  the  medical  record 
any  time  within  the  eight-month  study  period. 
VARIATION  RATE:    58%  CLASS  DR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

076  Past  Medical  Hx  Done  20  40  23  .10  1.3 

B.  Criterion  2  -  Heart  Examination  -  In  order  to  meet  this  criterion,  there 
must  be  documented  evidence  of  examination  of  the  heart  on  or  after  the 
date  the  patient  was  treated  for  acute  or  episodic  chest  pain. 
VARIATION  RATE:    19%  CLASS  DR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

049  Heart  Exam  Done  42  84  86  .36  5.0 

C.  Criterion  3  -  Chest  Wall  or  Lung  Examination  -  In  order  to  meet  this 
criterion,  there  must  be  documented  evidence  of  chest  wall  or  lung 
examination  on  or  after  the  date  the  patient  was  treated  for  acute 
or  episodic  chest  pain. 

VARIATION  RATE:    12%  CLASS  DR 

 SAMPLE  DATA  RATES  ' 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

077  Chest/Lung  Exam  Done  45  90  114  .48  6.6 
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TABLE  8  (CONT'D) 

D.     Criterion  4  -  Blood  Pressure  Values  -  In  order  to  meet  this  criterion, 
there  must  be  blood  pressure  values  documented  on  or  after  the  date  the 
patient  was  treated  for  acute  or  episodic  chest  pain. 


VARIATION  RATE:  6% 


CLASS  DR 


SAMPLE  DATA 


RATES 


DATA  ITEMS  REQ 

003  Systolic  BP  Values 

004  Diastolic  BP  Values 


PER  PER 

NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 


49 
49 


98 
98 


187 
187 


.79  10.8 
.79  10.8 


E.     Criterion  5  -  Assessment  and  Follow-up  -  In  order  to  meet  this  criterion, 
there  must  be  documented  evidence  of  assessment  or  follow-up  of  the 
problem  on  or  after  the  date  the  patient  was  treated  for  acute  or 
episodic  chest  pain.    A  diagnosis  must  be  made  or  follow-up  care  such 
as  a  specific  reappointment  interval,  referral  to  a  consultant  or 
hospitalization  must  be  documented. 
VARIATION  RATE:    21%  CLASS  TR 


SAMPLE  DATA  RATES 

PER  PER 


DATA  ITEMS 

REQ  NO. 

PATIENTS 

%  NO. 

PROCEDURES 

VISIT 

PAT. 

203  Subsequent  Dx 

Sequence 

35 

70 

64 

.27 

3.7 

800  Revisit 

Sequence 

40 

80 

101 

.43 

5.8 

801  Consult 

Sequence 

10 

20 

19 

.08 

1.1 

802  Hosp. 

Sequence 

7 

14 

8 

.03 

0.5 

803  Other 

Sequence 

19 

38 

26 

.11 

1.5 
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F.     Other  Criteria 


DATA  ITEMS 
006  EKG 

010  Chest  X-Ray 

017  4  Hr  pp  Blood  Glucose 

019  Glucose  Tol . 

024  Serum  Cholesterol 

026  UA 

027  CBC 

029  Fasting  Glucose 

030  2  Hr  pp  Glucose 

031  Random  Glucose 
053  Family  Hx 

078  Hx  Prev.  Chest  Pain 
090  Screening  Panels 

107  Atar/Tranq 

108  Sedatives 

113  Sk.  Muse.  Relax. 

114  Salycilates 

115  Analgesics 

116  Narcotics 

117  Phenyl.  Buta. 

118  Indomethacin 


SAMPLE  DATA  RATES 


REQ 

NO.  PATIENTS 

%  NO. 

PROCEDURES 

PER 
VISIT 

PER 
PAT.  YR 

Done 

37 

74 

40 

.17 

2.3 

Done 

22 

44 

22 

.09 

1.3  ■ 

Value 

1 

2 

1 

.00 

0.1 

Value 

0 

0 

0 

.00 

0.0 

Value 

16 

32 

20 

.08 

1 .2 

Value 

20 

40 

22 

.09 

1 .3 

Value 

25 

50 

26 

.11 

1.5 

Value 

10 

20 

14 

.05 

0.8 

Value 

1 

2 

1 

.00 

0.1 

Value 

12 

24 

13 

.05 

0.8 

Done 

14 

28 

15 

.06 

0.9 

Done 

35 

70 

62 

.26 

3.6 

Done 

14 

28 

16 

.07 

0.9 

Done 

16 

32 

52 

.22 

3.0 

Done 

3 

6 

6 

.03 

0.3 

Done 

1 

2 

2 

.01 

0.1 

Done 

9 

18 

10 

.04 

0.6 

Done 

10 

20 

13 

.05 

0.8 

Done 

8 

16 

8 

.03 

0.5 

Done 

0 

0 

0 

.00 

0.0  . 

Done 

0 

0 

0 

.00 

0.0 
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7.     ARTHRITIS  Cases:  734  Mean  Patient  Years:  1.25 

Sample  Size:    51  Visits  per  Patient  Year:  11.3 

A.  Criterion  1  -  Past  Medical  History  Done  -  In  order  to  meet  this  criterion, 
evidence  of  a  history  including  history  for  peptic  ulcer  of  gastro- 
intestinal bleeding  must  appear  in  the  medical  record.    This  criterion 
applies  to  all  patients  in  the  study. 

VARIATION  RATE:  81%  CLASS  DR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

079  Hx  Incl.  Ulcer,  G.I. 

Bleeding  Done  13  25  15  .02  0.2 

B.  Criterion  2  -  No  Prescription  of  Systemic  Steroids  -  This  criterion  is 
restricted  to  patients  diagnosed  within  the  study  period.  In  order  to 
meet  the  criterion,  there  may  be  no  systemic  steroids  prescribed  on  or 
after  the  diagnosis  date. 

VARIATION  RATE:  14%  CLASS  TP 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

120  Systemic  Steroid  Absent  9  18  21  .03  0.3 

C.  Criterion  3  -  Aspirin  Prescribed  Before  Anti- Inflammatory  Agents  -  This 

criterion  is  restricted  to  patients  who  were  diagnosed  within  the  study 

period  and  who  received  anti -inflammatory  agents.    Of  those  patients, 

aspirin  must  precede  the  prescription  of  anti -inflammatory  agents  unless 

the  patient  had  active  gastrointestinal  bleeding  or  peptic  ulcer.  In 

the  case  of  active  gastrointestinal  bleeding  or  peptic  ulcer  the 

criterion  was  met  if  aspirin  was  not  prescribed. 

VARIATION  RATE:    71%  CLASS  TC 
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 SAMPLE  DATA  RATES 

PER  PER 


nATA  TTCMC 

UA 1  A  11  trio 

rn  1  1  LIN  1  o 

h      INU . 

ppnrrni  ippc 

rl\ULcUUi\L  J 

VKTT 

V  X  O  i  1 

PAT 

rnl  « 

080  6.1.  Bleeding 

Sequence 

4 

8 

4 

.01 

0.1 

081  Active  Peptic  Ulcer 

Sequence 

0 

0 

0 

.00 

0.0 

114  Aspirin 

Sequence 

22 

43 

86 

.12 

1.4 

119  Anti-Inflam.  Agent 

Sequence 

20 

39 

80 

.11 

1.3 

D.     Criterion  4  -  Phenyl butazone  Derivitives  and/or  Indomethacin  not 
Prescribed  if  the  Patient  has  Active  Gastrointestinal  Bleeding  or 
Peptic  Ulcer  -  This  criterion  is  limited  to  those  patients  who  received 
Phenylbutazones,  Indomethacin  and/or  Naproxen.    In  order  to  meet  the 
criterion,  there  must  not  be  any  evidence  of  gastrointestinal  bleeding 
or  peptic  ulcer  within  the  study  period.    If  no  medical  history  is  done, 
the  criterion  is  not  met. 
VARIATION  RATE:    86%  CLASS  TC 


SAMPLE  DATA  RATES 

PER  PER 


DATA  ITEMS 

REQ  NO. 

PATIENTS 

%  NO. 

PROCEDURES 

VISIT 

PAT. 

080  G.I.  Bleeding 

Sequence 

4 

8 

4 

.01 

0.1 

081  Active  Peptic  Ulcer 

Sequence 

0 

0 

0 

.00 

0.0 

117  Phenylbutazones 

Sequence 

6 

12 

15 

.02 

0.2 

118  Indomethacin 

Sequence 

15 

29 

38 

.05 

0.6 

E.     Criterion  5  -  No  hospitalization  for  Arthritis  -  This  criterion  applies 
to  all  patients.    In  order  to  meet  this  criterion,  there  must  not  be 
evidence  that  the  patient  was  hospitalized  for  arthritis  within  the 
two-year  study  period. 
VARIATION  RATE:    5%  CLASS  TP 
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DATA  ITEMS 

802  Hosp.  for  Arthritis 
F.    Other  Criteria 

DATA  ITEMS 
009  Bone  X-Ray 

026  Urinalysis 

027  CBC 

053  Family  Hx 

082  Sed.  Rate 

083  RH  Factor 

084  Antinuclear  Ant. 
204  Types  of  Arthritis 

115  Non-Salcylates 

116  Narcotics 

121  Int.  Cost. 

122  Gold.  Prep. 

123  Antimalarials 
150  Phys.  Therapy 

800  Revisit 

801  Consult 

803  Other  Dispos. 

804  Other  Hosp. 


 SAMPLE  DATA  RATES 

PER  PER 

REQ  NO.  PATIENTS  %  NO.  PROCEDURES  VISIT  PAT.  YR. 
Absent  3  6  3  .00  0.0 


 SAMPLE  DATA  RATES 

PER  PER 

REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 


U\J  I IC 

?4 

47 

34 

05 

0  5 

Val  up 

?c 

49 

68 

09 

1  1 

1  •  1 

Val  up 

28 

78 

1 1 

•  1  1 

1  2 

Dnnp 

U\J  1  1  c 

17 

1  / 

33 

18 

03 

0  3 

Val  ue 

18 

35 

26 

04 

0  4 

Val  ue 

V  u  1  UC 

Q 

J 

18 

g 

01 

0  1 

Val  up 

4 

5 

01 

0  1 

Value 

42 

82 

133 

.18 

2.1 

Done 

17 

33 

57 

.08 

0.9 

Done 

3 

6 

8 

.01 

0.1 

Done 

6 

12 

10 

.01 

0.1 

Done 

2 

4 

53 

.07 

0.8 

Done 

0 

0 

0 

.00 

0.0 

Done 

22 

43 

77 

.11 

1.2 

Done 

48 

94 

322 

.45 

5.1 

Done 

19 

37 

48 

.07 

0.8 

Done 

4 

8 

14 

.02 

0.2 

Done 

12 

24 

24 

.03 

0.3 
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8.    PREVENTIVE  CARE  -  ADULT       Cases:  852      Mean  Patient  Years:  0.21 

Sample  Size:     52      Visits  Per  Patient  Year:  15.3 

A.  AV1_  abnormal  laboratory  results  recognized  -  In  order  to  meet  this 
criterion,  all  laboratory  test  results  which  were  above  or  below  normal 
limits  for  the  practice  site  must  be  recognized  by  the  physician.  If 
there  was  an  abnormal  laboratory  result  reported  but  no  documented 
evidence  of  recognition  by  the  physician,  the  case  will  not  meet  this 
criterion. 

VARIATION  RATE:    25%  CLASS  DR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

900  Abnormal  Lab.  Results    Values  12  23  21  .13  1.9 

B.  Tetanus  History  Documented  -  In  order  to  meet  this  criterion,  there 
must  be  documented  evidence  in  the  medical  record  of  the  patients 
tetanus  toxoid  immunization  history.    If  immunization  history  was  not 
in  the  record,  the  case  will  not  meet  this  criterion. 

VARIATION  RATE:    53%  CLASS  DR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS      %    NO.  PROCEDURES    VISIT    PAT.  YR. 

058  Tetanus  History  Done  25  48  26  .16  2.4 

C.  Plans  for  Incomplete  Tetanus  Toxoid  Immunization  -  In  order  to  meet  this 
criterion,  there  must  be  documented  evidence  in  the  medical  record  that, 
when  indicated,  tetanus  toxoid  immunization  is  either  given  or  planned 
to  be  given.    If  there  was  no  immunization  history  or  plans  for  immuni- 
zation, the  case  does  not  meet  the  criterion.    If  the  date  of  the  last 
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immunization  was  not  recorded  or  if  the  most  recent  immunization  was 
ten  years  ago  or  more  and  no  plans  for  immunizations  were  documented, 
the  case  does  not  meet  the  criterion. 
VARIATION  RATE:    66%  CLASS  TC 

 SAMPLE  DATA  RATES 

"  PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

059  Last  Tetanus  Tox.         Done  18  35  18  .11  1.6 

060  Tetanus  Tox.  Given        Done  7  13  7  .04  0.6 

D.  Smoking  History  Documented  -  In  order  to  meet  this  criterion,  there 
must  be  documented  evidence  in  the  medical  record  that  the  patient's 
history  of  smoking  was  taken. 

VARIATION  RATE:    38%  CLASS  DR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

056  Smoking  History  Done  38  73  40  .24  3.7 

E.  Smoking  Patient  Education  -  In  order  to  meet  this  criterion,  there  must 
be  documented  evidence  in  the  medical  record  that  all  patients  who  smoke 
were  given  patient  education.    If  the  patient  is  a  nonsmoker,  the 
criterion  is  met.    If  no  smoking  history  was  documented  or  if  the 
patient  who  smokes  does  not  receive  smoking  patient  education,  the 
criterion  is  not  met. 

VARIATION  RATE:    56%  CLASS  TC 

 SAMPLE  DATA  RATES 

'  PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

703  Smoking  Pat.  Ed.  Done  1  2  1  .01  0.1 
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F.  Alcohol  History  Documented  -  In  order  to  meet  this  criterion,  there 
must  be  documented  evidence  in  the  medical  record  that  the  patient's 
history  of  drinking  alcohol  was  taken. 

VARIATION  RATE:    39%  CLASS  DR 

 SAMPLE  DATA  RATES  ■ 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

057  Alcohol  History  Done  32  62  36  .22  3.3 

G.  Alcohol  Patient  Education  -  In  order  to  meet  this  criterion,  there 
must  be  documented  evidence  in  the  medical  record  that  all  patients 
who  drink  alcohol  receive  patient  education.    If  the  patient  is  a 
non-drinker,  the  criterion  is  met.    If  no  alcohol  history  is  documented 
or  if  a  patient  who  uses  alcohol  did  not  receive  patient  education,  the 

criterion  is  not  met. 

VARIATION  RATE  58%  CLASS  TC 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

704  Alcohol  Pat.  Ed.  Done  2  4  4  .02  0.4 

H.  Seat  Belt  Use  History  -  In  order  to  meet  this  criterion,  there  must 

be  documented  evidence  in  the  medical  record  that  the  patient's  history 
concerning  the  use  of  the  automobile  seat  belts  was  taken. 
VARIATION  RATE:    78%  CLASS  DR 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

063  Use  of  Seat  Belt  Done  9  17  9  .05  0.8 
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I.     Seat  Belt  Patient  Education  -  In  order  to  meet  this  criterion,  there 
must  be  documented  evidence  in  the  medical  record  that  patients  who  do 
not  use  automobile  seat  belts  by  history  receive  patient  education.  If 
no  seat  belt  use  history  is  documented  or  if  the  non-seatbelt  user  did 
not  receive  patient  education,  the  criterion  is  not  met. 
VARIATION  RATE:    96%  CLASS  TC 

 SAMPLE  DATA  RATES 

PER  PER 

DATA  ITEMS  REQ       NO.  PATIENTS     %    NO.  PROCEDURES    VISIT    PAT.  YR. 

705  Seat  Belt  Education      Done  0  0  0  .00  0.0 

J.     Other  Criteria 

LAB  TESTS  ALSO  USED  IN  CRITICAL  CRITERIA  A 

 SAMPLE  DATA  RATES 

PER  PER 


DATA  ITEMS 

REQ 

NO.  PATIENTS 

%  NO. 

PROCEDURES 

VISIT 

PAT. 

021  BUN 

Value 

41 

79 

43 

.26 

3.9 

023  Serum  Uric  Acid 

Value 

42 

81 

44 

.27 

4.0 

024  Serum  Cholesterol 

Value 

39 

75 

42 

.25 

3.8 

026  Urinalysis 

Value 

41 

79 

52 

.31 

4.8 

027  CBC 

Value 

42 

81 

43 

.26 

3.9 

028  Hematocrit 

Value 

38 

73 

38 

.23 

3.5 

029  Fastial  Blood  Sugar 

Value 

12 

23 

12 

.07 

1.1 

030  2  Hr  pc  Blood  Sugar 

Value 

2 

4 

2 

.01 

0.2 

031  Random  Blood  Sugar 

Value 

34 

65 

40 

.24 

3.7 

038  Pap  Smear 

Value 

22 

42 

25 

.15 

2.3 

039  Calcium 

Value 

32 

62 

33 

.20 

3.0 

040  Phosphorous 

Value 

32 

62 

33 

.20 

3.0 

041  Total  Protein 

Value 

32  . 

62 

33 

.20 

3.0 

90 


TABLE  8  (CONT'D) 


042  Serum  Alb. 

Value 

32 

62 

33 

.20 

3.0 

043  Bilirubin 

Value 

32 

62 

33 

.20 

3.0 

HAA    fill/  Dhncnh 

Uft  mik.  rnospn. 

no 

77 

4? 

HC 

?  P. 

045  LDH 

Value 

32 

62 

33 

.20 

3.0 

046  SGOT 

Value 

40 

77 

42 

.25 

3.8  . 

OTHER  ITEMS 

SAMPLE  DATA 

RATES 

DATA  ITEMS 

REQ 

NO.  PATIENTS     %  NO. 

PROCEDURES 

PER 

\/TC  TT 
V  iol  1 

PER 

DAT  VD 

002  Weight 

Value 

oU 

yo 

116 

.  oy 

ins 

1  u .  D 

003  Systolic  BP 

Value 

CO 

oc 

1  UU 

129 

77 

n  p 

II  .o 

004  Diastolic  BP 

Value 

CO 
DC 

i  on 
1  UU 

129 

77 

1  1  .  o 

005  Optic  Fundi 

Done 

o  o 

A  A 

44 

23 

.  1  4 

0  1 

006  EKG 

Done 

2 1 

40 

22 

.  1  6 

010  Chest  X-Ray 

Done 

11 

21 

11 

r>7 
.07 

1  .0 

047  Tonometry  (R) 

Done 

19 

36 

19 

.11 

1.7 

048  Tonometry  (L) 

Done 

20 

38 

20 

.12 

1.8 

049  Heart  Exam 

Done 

48 

92 

58 

.35 

5.3 

050  Rectal  Exam 

Done 

34 

65 

36 

.22 

3.3 

051  Procto.  Exam 

Done 

5 

10 

5 

.03 

0.5 

052  Sigmoid 

Done 

4 

8 

5 

.03 

0.5 

053  Family  History 

Done 

42 

81 

44 

.27 

4.0 

054  Sexual  History 

Done 

27 

52 

39 

.23 

3.6 

055  Rev.  of  Systems 

Done 

39 

75 

40 

.24 

3.7 

061  Allergies  Noted 

Done 

43 

83 

48 

.29 

4.4  " 

062  Current  Meds. 

Done 

39 

75 

64 

.38 

5.9 
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064  Marital  Status 

Done 

38 

73 

39 

.23 

3.6 

065  Work  History 

Done 

29 

56 

32 

.19 

2.9 

070  Abdominal  Exam 

Done 

50 

96 

60 

.36 

5.5 

071  Breast  Exam 

Done 

34 

65 

34 

.20 

3.1 

072  Testicular  Exam 

Done 

15 

29 

15  . 

.09 

1.4 

090  Screening  Panel 

Done 

37 

71 

42 

.25 

3.8 

706  Exercise  Counselling 

Done 

0 

0 

0 

.00 

0.0 

800  Revisit 

Done 

32 

62 

53 

.32 

4.9 

801  Consult 

Done 

9 

17 

10 

.06 

0.9 

802  Hosp. 

Done 

3 

6 

3 

.02 

0.3 

803  Other  Dispos. 

Done 

14 

27 

20 

.12 

1.8 

92 


DESCRIPTION  OF  VARIATION  DATA 

Variations  were  identified  for  each  critical  criteria  item  by  topic 
and  site.    Table  9  shows  these  variations  as  percentage  deviations  from 
full  compliance.    Thus,  whether  the  critical  criteria  involve  a  positive 
requirement  as  in  the  case  of  "Blood  Sugar"  or  a  negative  requirement  as 
in  the  case  of  "No  Hospitalization,"  low  variation  percents  indicate 
good  compliance  and  high  variation  percents  indicate  poor  compliance. 
As  previous  studies  have  indicated,  use  of  critical  criteria  can  result 
in  large  variation  rates.    Therefore,  until  the  justification  procedures 
are  complete,  the  variation  rate  per  site  should  not  be  interpreted  as 
a  reflection  of  quality  of  care. 

Deficiencies  are  also  shown  as  percentage  deviations  from  full  com- 
pliance for  those  items  reviewed  by  the  practices.    Deficiency  rates, 
presented  in  Table  9  are  not  reliable  since  a  variety  of  techniques  were 
used  to  justify  variation  from  critical  criteria.    In  some  instances, 
review  occurred  for  only  a  small  sample  of  cases  or  by  an  incomplete 
set  of  participating  physicians. 

Mean  variation  rates  are  figured  on  the  basis  of  total  data  for  all 
sites  and  are  not  the  average  of  the  ten  site  variation  rates.  Combined 
variation  rates  for  all  criteria  together  for  each  topic  ranged  from  23% 
variations  for  Chest  Pain  criteria  to  57%  for  Preventive  Care,  Adult, 
and  averaged  44%  variation  for  all  topics.    The  mean  variation  rates  by 
topic  are  given  in  Table  10.    Mean  rates  are  not  given  for  deficiencies 
because  of  the  large  number  of  variations  that  were  not  reviewed  by  the 
practices. 
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Variation  rates  by  site  are  shown  in  Table  11.    These  ranged  from  32% 
to  55%  with  a  mean  rate  of  44%.    Site  6  and  site  9  which,  as  indicated 
previously,  showed  31  physicians  between  them,  nevertheless  came  up  with 
quite  different  variation  rates:    52%  for  site  6  and  44%  for  site  9. 
This  suggests  that  differences  in  variation  rates  may  be  more  effected 
by  the  patient  mix  at  a  particular  site  than  by  the  physician  involved. 
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TABLE    9A.  CRITICAL  CRITERIA  VARIATIONS  AND  DEFICIENCIES  BY  SITE 
Shown  as  Percentage  Deviations  from  Full  Compliance  with  each  Criterion 

1.    DIABETES  MELLITUS 

Sites 

Mean 

CRITERIA  ]  2  3  4  5  6  7  8  9  10  Variations 

Var/Def   Var/Def     Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def  Var/Def 


1. 

Blood  Sugar 

67 

22 

63 

0 

61 

27 

44 

* 

56 

31 

62 

37 

29 

0 

48 

* 

43 

12 

79 

* 

51 

* 

2. 

Visits 

20 

* 

6 

0 

34 

14 

21 

* 

59 

34 

33 

10 

43 

3 

47 

* 

33 

17 

40 

* 

36 

* 

3. 

No  Wt.  Gain 

20 

* 

6 

0 

16 

5 

20 

* 

30 

20 

30 

* 

17 

0 

25 

* 

32 

* 

19 

* 

23 

* 

4. 

Diet 

0 

* 

0 

0 

6 

3 

2 

* 

0 

0 

2 

0 

4 

2 

5 

* 

7 

* 

0 

* 

3 

* 

5. 

No  Hosp. 

17 

* 

38 

0 

34 

9 

24 

* 

26 

3 

25 

* 

21 

2 

21 

* 

31 

* 

40 

* 

26 

* 

Variations  not  reviewed  by  practice. 


TABLE  9B.    CRITICAL  CRITERIA  VARIATIONS  AND  DEFICIENCIES  BY  SITE 
Shown  as  Percentage  Deviations  from  Full  Compliance  with  each  Criterion 


2.  HYPERTENSION 


Sites 

Mean 

CRITERIA  1  2  3  4  5  6  7  8  53  10  Variations 


Var/Def 

Var/Def 

Var/Def 

Var/Def 

Var/Def 

Var/Def 

Var/Def 

Var/Def 

Var/Def 

Var/Def 

Var/Def 

1. 

B/P 

29 

4 

23 

0 

33 

* 

40 

2 

31 

16 

62 

41 

50 

35 

43 

6 

33 

19 

30 

* 

38  * 

2. 

Visits 

32 

1 

9 

0 

32 

* 

21 

2 

62 

29 

48 

10 

53 

36 

45 

9 

50 

16 

46 

42  * 

3. 

Fundoscopic 

58 

19 

45 

5 

38 

* 

63 

32 

32 

16 

49 

15 

78 

61 

47 

25 

38 

20 

28 

* 

47  * 

4. 

Drugs 

5 

0 

14 

0 

1 

8 

1 

3 

1 

3 

0 

7 

3 

3 

0 

4 

2 

5 

* 

5  * 

5. 

Urinalysis 

23 

6 

68 

14 

40 

* 

26 

11 

31 

25 

22 

10 

36 

24 

27 

11 

32 

16 

26 

30  * 

6. 

Ser.  Pot. 

21 

5 

50 

14 

88 

* 

73 

45 

15 

12 

26 

10 

70 

55 

32 

19 

25 

17 

23 

* 

42  * 

7. 

EKG 

33 

* 

* 

49 

* 

62 

* 

54 

* 

40 

83 

* 

46 

* 

51 

* 

47 

56  * 

♦Variations  not  reviewed  by  practice. 


TABLE  9C.    CRITICAL  CRITERIA  VARIATIONS  AND  DEFICIENCIES  BY  SITE 
Shown  as  Percentage  Deviations  from  Full  Compliance  with  each  Criterion 

3.     ISCHEMIC  HEART  DISEASE 

Sites 

Mean 

CRITERIA  ]  2  3  4  5  6  7  8  9  10  Variations 

Var/Def    Var/Def     Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def  Var/Def 


I. 

Smoking  Hx 

43 

* 

23 

20 

78 

66 

72 

* 

68 

16 

75 

19 

85 

54 

56 

* 

60 

16 

62 

* 

65 

* 

2. 

Smoking  Educ 

51 

* 

53 

* 

88 

78 

84 

* 

81 

20 

88 

28 

90 

63 

90 

* 

66 

24 

73 

* 

76 

* 

3. 

EKG 

37 

* 

67 

7 

28 

22 

44 

* 

28 

7 

28 

3 

79 

38 

11 

* 

16 

8 

20 

* 

32 

* 

4. 

No  M.I. 

4 

* 

0 

0 

16 

5 

4 

* 

8 

7 

0 

0 

6 

2 

1 

* 

20 

10 

4 

* 

7 

* 

5. 

No  Card.  Dth. 

2 

* 

7 

* 

2 

* 

3 

* 

0 

0 

0 

0 

4 

4 

1 

* 

12 

4 

1 

* 

3 

* 

6. 

Visits 

20 

* 

20 

7 

21 

12 

12 

* 

46 

12 

22 

* 

27 

10 

26 

* 

42 

20 

52 

* 

31 

* 

Variations  not  reviewed  by  practice. 


TABLE  9D.     CRITICAL  CRITERIA  VARIATIONS  AND  DEFICIENCIES  BY  SITE 
Shown  as  Percentage  Deviations  from  Full  Compliance  with  each  Criterion 


4.  ANXIETY/DEPRESSION 


Sites 


CRITERIA 


1 


8 


10 


Mean 
Variations 


co 


1. 

2. 
3. 
4. 


Psych/Couns, 
No  Sed. 
Follow  Up 
No  Suicide 


Var/Def  Var/Def 
25     0     17  0 

1*00 
62     0     52  0 

0*44 


Var/Def  Var/Def  Var/Def  Var/Def  Var/Def  Var/Def  Var/Def  Var/Def 

50     *  57     *  11      *  46     *  69     *  64     *  39     0  90  * 

1*  7*  4*  3*  12*  2*  81  0* 

50     *  75     *  54     *  73     *  93     *  82     *  68     5  45  * 

0*  4*  2*  4*  1*  3*  21  0* 


Var/Def 
45  * 

4  * 
66  * 

2  * 


Variations  not  reviewed  by  practice. 


TABLE  9E.    CRITICAL  CRITERIA  VARIATIONS  AND  DEFICIENCIES  BY  SITE 
Shown  as  Percentage  Deviations  from  Full  Compliance  with  each  Criterion 

5.    CHEST  PAIN 

Sites 

Mean 

CRITERIA  1  2  3  4  5  6  7  8  9  10  Variations 

Var/Def    Var/Def     Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def  Var/Def 


1. 

Past  Hx 

41 

* 

42 

0 

48 

* 

66 

* 

46 

8 

74 

5 

100 

* 

85 

* 

67 

5 

38 

* 

58 

* 

2. 

Heart  Exam 

24 

* 

0 

0 

14 

* 

14 

* 

21 

4 

47 

5 

32 

* 

10 

* 

16 

1 

29 

* 

19 

* 

3. 

Ch/Lng  Exam 

16 

* 

0 

0 

9 

14 

* 

8 

1 

37 

5 

42 

* 

10 

* 

9 

1 

5 

* 

12 

* 

4. 

B/P  Values 

4 

* 

0 

0 

5 

* 

0 

* 

5 

* 

5 

0 

0 

* 

5 

* 

12 

0 

24 

* 

6 

* 

5. 

Assmnt. 

47 

42 

0 

21 

23 

* 

9 

3 

21 

5 

42 

* 

5 

* 

19 

0 

14 

* 

21 

* 

Follow  Up 


♦Variations  not  reviewed  by  practice. 


TABLE  9F.    CRITICAL  CRITERIA  VARIATIONS  AND  DEFICIENCIES  BY  SITE 
Shown  as  Percentage  Deviations  from  Full  Compliance  with  each  Criterion 

6.    URINARY  TRACT  INFECTION 

Sites 

Mean 

CRITERIA  1  2  3  4  5  6  7  8  9  10  Variations 

Var/Def   Var/Def     Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def  Var/Def 


1. 

Hx  of  UTI 

65 

3 

19 

7 

68 

* 

64 

44 

5 

88 

19 

85 

62 

54 

4 

* 

58 

* 

2. 

Urinalysis 
Before  Treat. 

11 

* 

0 

0 

22 

10 

* 

6 

0 

31 

0 

13 

* 

15 

* 

3 

* 

* 

* 

11 

* 

3. 

Follow  Up 

37 

* 

11 

0 

42 

* 

28 

45 

5 

31 

0 

74 

* 

32 

* 

23 

0 

* 

* 

36 

* 

4. 

UR  Cult. 

66 

* 

88 

85 

87 

* 

78 

67 

n 

69 

0 

88 

80 

* 

71 

2 

* 

76 

* 

5. 

Treatment 

5 

* 

25 

0 

25 

* 

17 

* 

8 

* 

33 

0 

0 

0 

0 

* 

9 

0 

* 

* 

8 

* 

Variations  not  reviewed  by  practice. 


TABLE  9G.     CRITICAL  CRITERIA  VARIATIONS  AND  DEFICIENCIES  BY  SITE 
Shown  as  Percentage  Deviations  from  Full  Compliance  with  each  Criterion 


7.  ARTHRITIS 

Sites 

Mean 

CRITERIA  1  2  3  4  5  6  7  8  9  10  Variations 

Var/Def    Var/Def     Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def  Var/Def 

1.    Past  Hx  66     2     39     0       82     *     78     *     75     *     93     7     97     *     86     *     96     5     85     *       81  * 


2. 

No  Steroids 

3 

0 

0 

0 

11 

* 

21 

* 

7 

* 

17 

0 

25 

* 

8 

* 

18 

0 

39 

* 

14 

* 

3. 

o 

Aspirin, 
Anti-Infl. 

80 

5 

50 

0 

72 

* 

82 

* 

65 

* 

89 

11 

35 

* 

78 

* 

59 

12 

82 

* 

71 

* 

4. 

Phenyl /ULC 

20 

0 

0 

0 

20 

* 

33 

* 

38 

* 

0 

0 

73 

* 

50 

* 

25 

* 

30 

* 

86 

* 

5. 

No  Hosp. 

1 

* 

0 

0 

5 

* 

8 

* 

4 

* 

10 

0 

5 

* 

5 

* 

5 

0 

5 

* 

5 

* 

♦Variations  not  reviewed  by  practice. 


TABLE  9H.     CRITICAL  CRITERIA  VARIATIONS  AND  DEFICIENCIES  BY  SITE 
Shown  as  Percentage  Deviations  from  Full  Compliance  with  each  Criterion 

8.    PREVENTIVE  CARE,  ADULT 

Sites 

Mean 

CRITERIA  ]  2  3  4  55  6  7  8  9  10  Variations 

Var/Def    Var/Def     Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def    Var/Def  Var/Def 


1 . 

Lab  Results 
Recognized 

4 

* 

33 

24 

2 

29 

* 

14 

2 

100 

17 

44 

7 

24 

* 

33 

3 

26 

25 

* 

2. 

Tet  Hx 

41 

2 

44 

* 

69 

60 

67 

* 

19 

100 

33 

74 

44 

42 

46 

29 

97 

* 

53 

* 

3. 

Tet  Immun. 

49 

6 

92 

84 

76 

69 

* 

72 

14 

83 

50 

74 

59 

43 

* 

55 

32 

100 

* 

66 

* 

4. 

Smoking  Hx 

7 

0 

11 

* 

13 

13 

70 

* 

12 

3 

67 

17 

33 

33 

7 

* 

50 

15 

57 

* 

38 

* 

5. 

Smoking  Educ 

30 

2 

28 

* 

36 

36 

81 

41 

7 

67 

33 

41 

33 

32 

* 

72 

39 

74 

* 

56 

* 

6. 

Alcohol  Hx 

9 

0 

17 

* 

13 

13 

70 

* 

14 

3 

67 

17 

26 

19 

6 

59 

15 

63 

* 

39 

* 

7. 

Alcohol  Educ 

25 

1 

53 

* 

27 

20 

81 

* 

32 

5 

67 

17 

70 

52 

41 

* 

78 

31 

74 

58 

* 

8. 

Seat  Belt  Hx 

30 

2 

97 

* 

13 

13 

100 

* 

41 

7 

100 

100 

100 

100 

100 

* 

99 

85 

89 

* 

78 

9. 

Seat  Belt 
Educ 

78 

6 

100 

89 

85 

100 

* 

97 

14 

100 

100 

100 

100 

100 

* 

99 

85 

91 

* 

96 

* 

♦Variations  not  reviewed  by  practice. 


TABLE  10.    MEAN  VARIATION  RATES  BY  TOPIC 

Mean  Variation 


 Topic  Rate 

1.  Diabetes  Mellitus  28% 

2.  Hypertension  37% 

3.  Heart  Disease  36% 

4.  Anxiety/Depression  29% 

5.  Chest  Pain  23% 

6.  UTI  38% 

7.  Arthritis  51% 

8.  Preventive  Care,  57% 

Adult 

ALL  TOPICS  44% 
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TABLE  11.    MEAN  VARIATION  RATES  BY  SITE 

Mean  Variation 
Site  Rate  

1  32% 

2 


3  41% 

4  48% 

5  36% 

6  52% 

7  55% 

8  40% 

9  44% 
10  49% 

ALL  SITES  44% 
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SECTION  VI 
RESOURCES  AND  COST 
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t 


INTRODUCTION  AND  METHOD 

This  section  presents  the  personnel  resources  used  by  SCPPSRO  in 
planning,  developing  and  operating  an  ambulatory  review  program  from 
October  1,  1976  to  June  30,  1978. 

Personnel  resources  for  specific  functions  are  analyzed  to  present 
trends  over  time  and  to  provide  some  indication  of  the  resources  required 
by  review  organizations  during  implementation  of  ambulatory  review. 

To  develop  accurate  information  on  resource  use,  SCPPSRO  collected 
personnel  hours  spent  on  specific  activities  and  forwarded  the  informa- 
tion to  HCMS.    Three  conditions  suggested  special  procedures  for  record- 
ing and  collecting  personnel  hours: 

1.  Having  SCPPSRO  personnel  record  their  hours  was  likely  to 
increase  the  face  validity  of  the  information  collected. 

2.  Vouchered  cost  information  was  not  considered  reliable 
because  of  the  variety  of  PSRO  procedures  used  in  billing 
the  Health  Standards  and  Quality  Bureau  (HSQB). 

3.  Vouchered  personnel  information  frequently  does  not  contain 
volunteer  physician  time  and  overtime  which  are  required 
for  an  accurate  estimate  of  resource  use. 

In  collecting  resource  information,  HCMS  and  the  PSRO  discussed 
systematic  recording  procedures,  developed  data  compilation  procedures 
and  defined  specific  terms  and  categories. 

Participants  in  the  demonstration  project  were  asked  to  describe 
their  ambulatory  review  activities  and  record  the  number  of  hours  spent 
on  a  daily  or  weekly  basis.    During  initial  discussions,  HCMS  and  the 
PSRO  developed  rigorous  procedures  for  collection  of  personnel  data,  and 
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a  monthly  activity  log  with  a  standard  format  was  designed  to  record 
information,  SCPPSRO  decided  to  use  their  own  logs.    The  logs  and  all 
minutes  of  meetings  were  forwarded  to  HCMS  on  a  monthly  basis. 

CATEGORIZATION  AND  COMPILATION  OF  RESOURCE  DATA 

To  facilitate  the  compilation  and  presentation  of  data,  HCMS  classi- 
fied the  information  contained  in  the  SCPPSRO  logs  into  a  standard  format 
composed  of  three  personnel  categories: 

1.  Physicians—including  physicians  working  either  in  staff 
capacity  or  as  special  panel  consultants 

2.  Management/Technical— a)  Management:    all  personnel  assigned 
the  responsibility  to  administer  the  project  or  to  assist 

in  managing  the  project,  and  b)  Technical:    personnel  prin- 
cipally engaged  in  technical  design  of  the  project,  analysis 
of  the  data,  providing  liaison  with  data  processing,  etc. 

3.  Data  Collection/Clerical--a)  Data  Collection:    those  personnel 
retrieving  data  from  medical  record  charts,  transforming  and 
coding  data  for  subsequent  processing,  etc.  and  b)  Clerical: 
secretarial  personnel  whose  duties  are  typing,  filing  and  general 
supporting  the  project. 

Each  participant  in  the  demonstration  project  was  classified  into  one  of 
the  above  three  categories  depending  on  type  of  work  performed  during  the 
reporting  periods.    Where  the  choice  between  categories  2  and  3  was  not 
clear,  persons  receiving  $7  or  more  per  hour  were  assigned  to  the  manage- 
ment/technical category  and  those  receiving  less  than  $7  per  hour  to  the 
data  collection/clerical  category. 
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Eight  major  functional  categories  were  identified  as  spanning  the 
entire  work  effort  of  the  project.    The  eight  functions  are: 

1.  Planning  and  Administration—includes  activities  relating  to 
system-wide  staffing  and  coordination,  system  design  and 
approach  and  the  administrative  support  activities  that 
facilitate  review  system  implementation. 

2.  Topic  Selection—work  related  to  identifying  problems  or 
topics  for  review  and  the  selection  of  those  topics 
likely  to  produce  the  greatest  benefit 

3.  Criteria  Development—development  of  criteria  related  to  the 
problem  or  topic  under  study  which  can  be  measured  or  com- 
pared by  data  being  collected 

4.  Data  Collection  (includes  abstracting)— activity  of  collecting 
information  from  required  data  sources. 

5.  Coding— activity  of  converting  abstracted  data  to  a  format 
acceptable  for  computer  entry.    This  includes  coding  of 
diagnoses  and  procedures. 

6.  Data  Processing  and  Analysis— activity  of  compiling,  organiz- 
ing and  displaying  data  in  preparation  for  professional 
interpretation.    The  processing  and  analysis  can  be 
accomplished  manually  or  by  machine. 

7.  Review  and  Decision-Making— professional  (physician  or 
other  staff)  examination  and  interpretation  of  processed 
information. 

8.  Feedback  and  Intervention— providing  to  those  individuals/ 
facilities/groups  results  of  analysis  and/or  review  and 
decision-making. 
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HCMS  allocated  the  personnel  hours  reported  to  the  appropriate 
function  by  personnel  category.    Some  interpretive  judgments  were  made 
in  determining  which  function  most  closely  correlated  to  the  work  done 
as  reported  by  the  activity  logs.    One  HCMS  staff  member  allocated 
activities  to  the  appropriate  category,  and  two  other  staff  members 
reviewed  the  process  for  consistency. 

Information  used  in  assigning  resources  to  appropriate  functions  and 
categories  was  taken  solely  from  data  entered  by  personnel  on  the  activity 
log.    Usually  PSRO  personnel  described  an  activity  in  detail  and  no  judgment 
was  required  in  assigning  it  to  a  function. 

SCPPSRO  subcontract  personnel  were  allocated  in  the  same  manner  as 
SCPPSRO  personnel  and  are  included  in  the  aggregated  data  shown  in  the 
various  tables  and  figures. 

PRESENTATION  OF  RESOURCE  DATA 

The  distribution  of  total  hours  expended  by  the  project  for  SCPPSRO 
and  subcontractor  personnel  by  personnel  category  and  function  is  shown 
in  Table  12.    The  percent  of  resources  used  for  each  of  the  eight  functions 
is  shown  in  total  and  separately  by  personnel  category.    Figure  3  is  a 
graphic  representation  of  this  table.    In  this  graph,  the  percent  of  total 
hours  worked  by  members  of  each  of  the  three  personnel  categories  is 
represented  horizontally  and  the  percent  of  hours  used  for  each  functional 
category  is  represented  vertically.    Areas  within  the  bars  are  proportional 
to  the  number  of  hours  expended  by  any  one  personnel  category  for  any  one 
function. 
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TABLE  12:    DISTRIBUTION  OF  TOTAL  PERSONNEL  HOURS 
BY  FUNCTION  AND  PERSONNEL  CATEGORY 


PERSONNEL  CATEGORY 


MGMT/  DATA/ 


FUNCTION 

MD  (%) 

TECHNICAL  (%) 

CLERICAL  (%) 

TOTAL 

[%) 

Planning  and  Administration 

324  (  44) 

2,595 

(  41) 

1,368  (  9) 

4,287 

(  19) 

Topic  Selection 

13  (  2) 

13 

(  0) 

Criteria  Development 

114  (  15) 

53 

(  1) 

46  (  0) 

213 

(  1) 

Data  Collection,  Abstracting 

181  (  24) 

819 

(  13) 

8,620  (  56) 

9,620 

(  43) 

Coding 

1,142  (  8) 

1,142 

(  5) 

Data  Processing 

20  (  3) 

2,595 

(  41) 

3,521  (  23) 

6,136 

(  28) 

Review  and  Decision  Making 

28  (  4) 

181 

(  3) 

61  (  0) 

270 

(  1) 

Feedback  and  Intervention 

58  8 

89 

563  4 

710 

llooi 

TOTAL 

738  (100) 

6,332 

hoo] 

15,321  (100) 

22,391 

PERCENT 

3% 

28% 

69% 

100% 
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FIGURE  3 

DISTRIBUTION  OF  TOTAL  PERSONNEL  HOURS  BY  FUNCTION  WITHIN  PERSONNEL  CATEGORY 
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TABLE  13    DISTRIBUTION  OF  PERSONNEL  HOURS  FOR  FUNCTIONS 
BY  CALENDAR  QUARTER  AND  PERSONNEL  CATEGORY 


FUNCTION 

LMLtNUAK 
QUARTER 

PERSONNEL  CATEGORY 

MD 

(%) 

MGMT/ 
TECHNICAL  (%) 

DATA/ 
CLERICAL  (%) 

TOTAL 

[%) 

Planning  and 

10-12/76 

82 

(  25) 

511  1 

20) 

189 

(  14) 

782 

(  18) 

Administration 

1-3  111 

60 

(  19) 

384 

15) 

378 

(  27) 

822 

(  19) 

4-6 

48 

(  15) 

318 

12) 

121 

(  9) 

487 

(  12) 

7-9 

49 

(  15) 

406 

;  i6) 

107 

(  8) 

562 

(  13) 

10-12 

38 

(  12) 

■j  10 

I  It) 

260 

(  19) 

613 

(  14) 

1-3  /78 

30 

(  9) 

349 

'  13) 

180 

(  13) 

559 

(  13) 

4-6 

17 

312 

]  12 

133 

462 

[looj 

TOTfll 
1  U  1  HL 

324 

fiooi 

2,595 

,100) 

1 ,368 

loo 

4,287 

PERCENT 

E 

\% 

605 

j 

32% 

100% 

Topic  Selec- 

10-12/76 

9 

(  69) 

9 

(  69) 

tion 

1-3  /77 
4-6 

1 

(  8) 

1 

(  8) 

7-9 
10-12 

1-3  /IB 
4-6 

3 

(  23) 

3 

(  23) 

1 U 1  ML 

13 

(100) 

13 

(100) 

PERCENT 

100% 

100% 

Criteria 

10-12/76 

24 

(  21) 

11 

(  21) 

35 

(  17) 

Development 

1-3  /77 

68 

(  59) 

9 

(  17) 

77 

(  36) 

4-6 

18 

(  16) 

10 

(  19) 

28 

(  13) 

7-9 

3 

(  3) 

2 

(  4) 

5 

(  2) 

10-12 

5 

(  9) 

21 

(  46) 

26 

(  12) 

1-3  /IB 

1 

(  1) 

25 

(  54) 

26 

(  12) 

4-6 

16 

16 

liooi 

TOTAL 

114 

(loo) 

53 

[loo 

46 

(100) 

213 

PERCENT 

i 

53% 

25% 

22% 

100% 

Data  Collec- 

10-12/76 

12 

(  7) 

12 

(  0) 

tion 

1-3  /77 

100 

(  55) 

285 

(  35) 

1 ,807 

(  21) 

2,192 

(  23) 

4-6 

57 

(  31) 

255 

(  31) 

2,560 

(  30) 

2,872 

(  30) 

7-9 

12 

(  7) 

238 

(  29) 

2,102 

(  24) 

2,352 

(  24) 

10-12 

2 

(  o) 

1,117 

(  13) 

1,119 

(  12) 

1-3  /IB 

3 

(  0) 

564 

(  7) 

567 

(  6) 

4-6 

36 

470 

(  5). 

506 

(  5) 

TOTAL 
PERCENT 

181 

(100) 

1% 

819 

8 

Uoj 

I 

8,620  (100) 
90% 

9,620  (100) 
100% 
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TABLE  13  (CONT'D) 


PFDCnWMFI 
r  trOUINNLL 

Ln  1  LuUf\  I 

FUNCTION 

CALENDAR 
QUARTER 

MD  (%) 

MGMT/ 
TECHNICAL  (%) 

DATA/ 
CLERICAL  (%) 

TOTAL  (%) 

Coding 

10-12/76 

1-3  111 

4-6 

7-9 
10-12 

1-3  /IS 

A  C 

283  (  25) 
254  (  22) 
175  (  15) 
91  (  8) 
150  (  13) 
1  P,Q  (  M) 

283  (  25) 
254  (  22) 
175  (  15) 
91  (  8) 
150  (  13) 
189  (  M) 

TOTAL 
PERCENT 

1  ,142  (100) 
100% 

1  ,142  (100) 
100% 

Data  Proces- 
sing 

10-12/76 

1-3  /77 

4-6 

7-9 
10-12 

1-3  /78 

A  C 

4-b 

6  (  30] 
11  (  55] 
3  (  1 5> 

303  (  12) 
497  (  19) 
488  (  19) 
i        436  (  17) 
1         564  (  21) 

I             "307    (    1  9  \ 

215  (  6) 
196  (  6) 
465  (  13) 
959  (  27) 
977  (  28) 

7DQ   /  9C\\ 

518  (  8) 
693  (  11) 
953  (  16) 
1,401  (  23) 
1,552  (  25) 
i  dip  (  ~\7) 

1  ,  U  1  -7     I  ill 

TOTAL 
PERCENT 

20  (lOo! 

0% 

i      2,595  (100) 
42% 

3,521  (100) 

58% 

6,136  (100) 
100% 

Review 

10-12/76 
1-3  /77 

A  C 

4-6 
7-9 
10-12 
1-3  /78 

A  C 

4-6 

15  (  54' 
13  46; 

34  (  19) 
70  (  39) 
1          51  (  28) 
1          26  14 

53  (  87) 
8  (13) 

34  (  13) 
70  (  26) 
119  (  44) 
47  (  17) 

TOTAL 
rtKLtN 1 

28  (100 
10% 

)         181  (100) 
67% 

61  (100) 

900/ 

270  (100) 

1  UU/o 

Feedback  and 
Intervention 

10-12/76 
1-3  /77 
4-6 

7-9 
10-12 
1-3  /78 
4-6 

36  (  62)          66  (  74) 
16  (  28) 
6  (  10)          23  (  26) 

155  (  28) 
292  (  52) 
116  20 

257  (  36) 
308  (  43) 
145  21 

TOTAL 
PERCENT 

58  (100 

8% 

)          89  (100) 
13% 

563  (100) 
79% 

710  (100) 
100% 
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APPENDIX  A 

SOUTHCENTRAL  PENNSYLVANIA  PSRO 
CRITICAL  CRITERIA 

AND 

AMBULATORY  CARE  DATA  BASE 
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APPENDIX  A 
SOUTHCENTRAL  PENNSYLVANIA  PSRO 
CRITICAL  CRITERIA 


DIABETES  MELLITUS 

1.  Three  visits  per  year 

2.  Fasting  blood  sugar  less  than  200  mg/100  ml  or  random  blood  glucose 

less  than  250  mg/100  ml 

3.  Weight  loss  (if  overweight) 

4.  Diet  therapy  before  oral  hypoglycemics 

5.  Hospitalization  (9%  standard) 

HYPERTENSION 

1.  Blood  pressure  not  greater  than  90  mmHG  diastolic  on  any  two  consecutive 

visits  beginning  two  months  after  onset  of  problem.  Must  have  at  least 
two  diastolic  readings  of  90  diastolic  or  less. 

2.  Three  visits  per  year 

3.  Funduscopic  examination 

4.  No  specific  antihypertensive  drug  until  diuretic  or  propranolol  started 

5.  Urinalysis 

6.  Serum  potassium  test  if  on  diuretic 


CHRONIC  ISCHEMIC  HEART  DISEASE 

1.  Smoking  history  recorded 

2.  Smoking  patient  education  (if  patient  smokes) 

3.  At  least  one  EKG  in  any  one-year  period 

4.  Myocardial  infarction  (0%  standard) 

5.  Cardiac  death  (0%  standard) 

6.  Three  visits  per  year 


ANXIETY  AND/OR  DEPRESSION 

1.  Counseling  or  psychotherapy 

2.  No  sedative  medication  if  problem  is  depression 

3.  Follow-up  appointment  mentioned  at  each  visit 

4.  No  suicide  attempt  or  success  since  treatment  started 


CHEST  PAIN 

1.  Past  medical  history  documented 

2.  Heart  examination  documented 

3.  Lung  examination  documented 

4.  Blood  pressure  recorded 

5.  Definitive  diagnosis  or  reappointment  scheduled 


ARTHRITIS 

1.  History  of  presence  or  absence  of  peptic  ulcer  or  G.I.  bleeding 

2.  Systemic  steroid  administration 

3.  Aspirin  prescription  before  other  anti  inflammatory  agents  (unless  allergic) 

4.  If  recent  history  (1-2  years)  of  ulcer  or  G.I.  bleeding,  no  phenylbutazone 

or  indomethacin  or  naproxen 

5.  No  hospitalization  for  arthritis 
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CRITICAL  CRITERIA  -  CONTINUED 


PREVENTIVE  CARE  -  ADULT 

1.  All  abnormal  laboratory  values  recognized 

2.  Tetanus  history  documented 

3.  Plans  for  incomplete  tetanus  immunization 

4.  Smoking  history 

5.  Smoking  patient  education  (unless  patient  doesn't  smoke) 

6.  Alcohol  intake  history 

7.  Alcohol  intake  patient  education  (unless  patient  doesn't  drink) 

8.  Seat  belt  use  history 

9.  Seat  belt  patient  education  (unless  patient  always  uses) 


URINARY  TRACT  INFECTION  (UTI) 

1.  Documentation  of  presence  or  absence  of  previous  UTI 

2.  Urinalysis  precedes  treatment 

3.  Definite  appointment  or  referral  made  at  first  visit 

4.  Urine  culture  or  gram  stain  one  week  or  more  after  discontinuation  of 

treatment 

5.  Treatment  for  at  least  two  weeks 
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SOUTHCENTRAL  PENNSYLVANIA  PSRO  AMBULATORY 
CARE  DATA  BASE 


TOPICS 


STUDY  TIME  FRAME 


1 .  Diabetes  Mellitus 

2.  Hypertension 

3.  Ischemic  Heart  Disease 

4.  Anxiety  and/or  Depression 

5.  Chest  Pain 

6.  Arthritis 

7.  Preventive  Care  -  Adult 

8.  U.T.I. 

DATA  ELEMENT* 
PATIENT  HISTORY 

1 .  Family  history 

2.  Sexual  history 

3.  Smoking  history 

4.  Alcohol  history 

5.  Immunization  history 

6.  Last  tetanus  toxoid  date 

7.  Allergies  noted 

8.  Current  medications  noted 

9.  Use  of  seat  belt  noted 

10.  Marital  status 

11.  Occupational  history 

12.  Impotence  noted 

13.  Mention  obesity 

14.  Prior  suicide  try 

15.  Past  history  (for  diagnosis) 

16.  History  of  chest  pain 

17.  History  of  ulcer 

18.  GI  bleeding  last  2  years 

19.  Peptic  ulcer  last  2  years 

20.  Exercise  history 

21 .  Recurrent  U.T.I. 

22.  Types  of  U.T.I,  specified 


2  years 
2  years 
2  years 
2  years 
8  months 
2  years 
7  months 
4  months 


TOPIC 
3  4 


5  6 


x  x 


X 

x 


X 

x 


X 

x 


x 
x 

X 


X 
X 
X 
X 
X 
X 
X 
X 
X 
X 
X 


X 
X 


EXAM 


1.  Height* 

2.  Weight* 

3.  Systolic  BP* 

4.  Diastolic  BP* 

5.  Optic  Fundi 

6.  Heart  exam 

7.  Rectal  exam 

8.  Peripheral  vascular  status 

9.  Neurological  exam 

10.  Chest  wall,  lung  exam 


x 
x 

X 
X 
X 


X 
X 


X 
X 
X 
X 
X 


X 
X 
X 
X 


X 
X 


X 
X 


X 
X 
X 
X 
X 
X 
X 


*An  asterisk  indicates  that  values  are  recorded  for  the  tests/procedures 
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DATA  ELEMENTS  (CONT.) 


1 


TOPIC 

2       3       4       5  6 


7  8 


LABORATORY 

1.  4  Hour  PP  blood  glucose* 

2.  Glucose  tolerance* 

3.  Serum  potassium* 

4.  Serum  uric  acid* 

5.  BUN* 

6.  Serum  creatinine* 

7.  Serum  cholesterol* 

8.  Triglycerides* 

9.  UA* 

10.  CBC/Hemoglobin* 

11.  Fasting  blood  sugar* 

12.  2  Hour  PP  blood  sugar* 

13.  Random  blood  sugar* 

14.  Plasma  renin* 

15.  Urinary    catechol emines* 

16.  Urinary  plasma  aldosterone* 

17.  Urinary  plasma  corticosteroids* 

18.  Pap  smear* 

19.  Calcium  * 

20.  Phosphorus* 

21.  Total  protein* 

22.  Serum  albumin* 

23.  Bilirubin* 

24.  Alkaline  phosphatase* 

25.  LDH* 

26.  SGOT* 

27.  T-4* 

28.  PBI* 

29.  Sedation  rate* 

30.  Rh  Factor  * 

31.  Antinuclear  antibody* 

32.  Screening  panels 

33.  UA  wltn  microscopic  * 

34.  Urine  culture  and  sensitivity"-' 

35.  Gram  stain* 

36.  Urine  screen* 


X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X  X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 
X 
X 
X 
X 
X 
X 
X 
X 

X 
X 

X 
X 

X 

X  XX 

X 
X 
X 


X-RAY 


1 .  Bone  x-ray* 

2.  Chest  x-ray* 

3.  IVP* 

4-  Renal  arteriogram  * 

5.  Voiding  cystourethrogram* 

6.  Retrograde  pyelogram* 


x 
x 

X 


X 
X 


*An  asterisk  indicates  that  values  are  recorded  for  the  tests/procedures 
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TOPICS 

DATA  ELEMENTS  (CONT.)  12       3       4       5       6       7  8 


DRUGS 


1 . 

Di  ureti  cs 

x 

x 

2. 

Propanol ol 

x 

x 

3. 

Other  anti hvDertensi ves 

x 

4. 

Ora  1   rnn  tra  rp  n  1*  i  vp^ 

x 

5. 

Potassium  supplements 

x 

6. 

Digitalis 

x 

x 

7. 

Ataractics,  tranauil izers 

x 

x 

x 

8. 

Sedatives 

x 

x 

x 

9. 

HvDonl vcemi  cs 

x 

io! 

Anti  depress  i  ves 

x 

n . 

Antimanic  druas 

A 

12 

Skplptal  mu<;r1p  rplaxant 

1  3 

a  1  irv1flfp<; 

Y 
A 

Y 

A 

14 

Ana lnpc  i  rc 

v 

A 

v 

A 

15. 

Narcotics 

x 

x 

16. 

Phenylbutazone 

X 

X 

17. 

Indomethacin 

X 

X 

18. 

Other  anti -inflammatory,  naproxen 

X 

19. 

Systemic  corticosteroids 

X 

20. 

Intra-articular/lesional  cortico. 

X 

21. 

Gold  preparations 

X 

22. 

Antimalarials 

X 

23. 

Nonsalicylates 

X 

24. 

Antibiotics 

25. 

Sulfanamides 

26. 

Anti-infectious  agents  NOS 

OTHER  THERAPEUTICS 

1.  Vasodilators 

2.  Cardiac  surgery 

3.  Physical  therapy 

4.  Tetanus  toxoid 


OTHER  DIAGNOSTIC  PROCEDURES 

1 .  EKG* 

2.  Exercise  EKG* 

3.  Tonometry 

4.  Visual  acuity 

5.  Proctoscopy 

6.  Sigmoidoscopy 

7.  Review  of  systems 

8.  Cystoscopy 


*An  asterisk  indicates  that  values  are  recorded  for  the  tests/procedures 


x 

X 
X 
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DATA  ELEMENTS  (CONT.) 


1  2 


ASSESSMENTS/OUTCOMES 

1 .  Mention  anxiety 

2.  Mention  depression 

3.  Subsequent  diagnosis 

4.  Type    of  arthritis  specified 

5.  Suicide  attempt  during  treatment 

6.  Suicide  success  during  treatment 

7.  Myocardial  infarct  x 

8.  Death  x 

PATIENT  EDUCATION 

1.  Diet  instruction  x       x  x 

2.  Salt  restriction  x 

3.  Smoking  education  x 

4.  Alcohol  education 

5.  Seatbelt  education 

6.  Exercise  counseling 

7.  Other  education  x 

8.  Psychologist  or  counseling 

PATIENT  DISPOSITION 

1.  Consultation  x  x 

2.  Hospitalization  x  x 

3.  Other  x  x 

4.  Specified  time  (revisit)  x  x 


ADMINISTRATIVE  DATA  ELEMENTS  - 
ALL  TOPICS 


1.  Patient  identification 

2.  Birth  date 

3.  Sex 

4.  Payment  status 

5.  Provider  identification 

6.  Facility  identification 

7.  Date  of  visit 
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APPENDIX  B 

SOUTHCENTRAL  PENNSYLVANIA  PSRO  DISPLAY 
FOR  SITE  INTERVENTION—CHEST  PAIN 
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;  "S^Sl  SOUTHCENTRAL  PENNSYLVANIA 

■  '.^jv  'Hill  l3*->:-vi.'52iiS 

Professional  Standards  Review  Organization 


APPENDIX  B 


Medical  Arts  Building,  Suite  201 
890  Poplar  Church  Road 
Camp  Hill,  PA  17011 


717-  761-5085 
SITE: 


SOUTHCENTRAL  PENNSYLVANIA  PSRO 
AMBULATORY  CARE  REVIEW  DEMONSTRATION  PROJECT 
THE  DATA  DISPLAY  FOR  SITE  INTERVENTION 
CHEST  PAIN 


AMCRO  5/78 
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SOUTHCENTRAL  PENNSYLVANIA 
Professional  Standards  Review  Organization 


Medical  Arts  Building,  Suite  201 
890  Poplar  Church  Road 
Camp  Hill,  PA  17011 


717  -  761-5085 


TABLE  OF  CONTENTS 

DATA  DISPLAYS  FOR  AMCRO  SITE  INTERVENTION 
CHEST  PAIN 


Age/Sex  Distribution   •  .1 

Study  Description  and  Summary  of  Critical  Criteria  2 

Description  of  Variation  Rates  and  Displays  3 

Critical  Criteria  Display  -  Participating  Practice  Site  4 

Critical  Criteria  Display  -  Distribution  of  Variation  Rates. 4 

Occurrence  of  Element  Display  ■  5,  6 

Distribution/Ranking  of  Occurrence  of  Elements  ...,.7,  8,  9 
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AMCP.O  DATA  DISPLAY 
AGE/SEX  DISTRIBUTION 

I.    Study:  Chest  Pain  Ages  inciuaed  in  this  study:        All  ages 


II.     This  Practice  Site  Site   ■      Total  patients    Total  male    Total  Female 


DISTRIBUTION 


# 


0-4  years 

5-9  years 

10-14  yrs 

15-24  yrs 

25-34  yrs 

35-44  yrs 

45-54  yrs 

55-64  yrs 

65  +  up 

M 

F 

M 

F 

M 

F 

M 

F 

M 

F 

M 

F 

H 

F 

M 

F 

H 

F 

III.    Project  Total  Total  patients     483  Total  male     265  Total  female  218 


DISTRIBUTION 


0-4  years 

5-9  ' 

years 

10-14 

yrs 

15-24  yrs 

25-34  yrs 

35-44  yrs 

45-54  yrs 

55-64  yrs 

65  +  up 

M 

F 

M 

F 

M 

F 

M 

F 

M 

F 

M 

F 

M 

F 

M 

F 

M 

F 

1 

4 

25 

22 

52 

36 

54 

34 

53 

42 

36 

30 

44 

50 

.002 

1% 

5% 

5% 

11% 

7% 

11% 

7% 

11% 

9% 

7% 

6% 

9% 

10% 
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SOUTHCENTRAL  PENNSYLVANIA 
Professional  Standards  Review  Organization 


Medical  Arts  Building,  Suite  201 
890  Poplar  Church  Road 
Camp  Hill,  PA  17011 


AMCRO  CHEST  PAIN  STUDY 
STUDY  DESCRIPTION  AND  SUMMARY  OF  CRITICAL  CRITERIA 


717  -  761-5085 


I.     Study  Description 


A.  Problem  -    Patients  included  in  this  study  had  episodic  or  acute 
chest  pain.     Patients  with  chronic  or  longstanding  chest  pain  were 
excluded  from  the  study. 

B.  Data  Collection  Period  -  Information  for  an  eight  month  period  was 
collected  from  medical  records.     Procedures  and  processes  of  care 
which  occurred  for  six  months  preceding  the  date  the  patient  was 
seen  by  the  practice  for  acute  chest  pain  and  two  months  following 
that  visit  were  recorded. 

C.  Patient  Populations  -  Numbers  of  patients  in  this  study  ranged  from 
12  to  97  patients  at  the  ten  participating  practice  sites.  The 
average  number  of  patients  was  48;  the  median  number  of  patients  was  43. 

II.     The  Critical  Criteria  for  the  Chest  Pain  Study  are: 

A.  Criterion  1  -  Past  Medical  History  -  In  order  to  meet  this  criterion, 
the  patient's  medical  history  must  be  documented  within  the  medical 
record  any  time  within  the  eight  month  study  period. 

B.  Criterion  2  -  Heart  Examination  -  In  order  to  meet  this  criterion, 
there  must  be  documented  evidence  of  examination  of  the  heart  on  or 
after  the  date  the  patient  was  treated  for  acute  or  episodic  chest  pain. 

C.  Criterion  3  -  Chest  Wall  or  Lung  Examination  -  In  order  to  meet  this 
criterion,  there  must  be  documented  evidence  of  chest  wall  or  lung 
examination  on  or  after  the  date  the  patient  was  treated  for  acute 
or  episodic  chest  pain. 

D.  Criterion  4  -  Blood  Pressure  Values  -  In  order  to  meet  this  criterion, 
there  must  be  blood  pressure  values  documented  on  or  after  the  date  the 
patient  was  treated  for  acute  or  episodic  chest  pain. 

E.  Criterion  5  -  Assessment  S  Follow-up  -  In  order  to  meet  this  criterion, 
there  must  be  documented  evidence  of  assessment  of  follow-up  of  the 
problem  on  or  after  the  date  the  patient  was  treated  for  acute  or 
episodic  chest  pain.    A  diagnosis  must  be  made  or  follow-up  care  such 
as  a  specific  reappointment  interval,  referral  to  a  consultant  or 
hospitalization  must  be  documented. 


Scr"!  ry  Adams,  Berks,  Cumberland,  Dauphin,  Franklin.  Fulton.  Lebanon,  Lancaster,  Perry,  Schuylkill.  York  Counties 
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DESCRIPTION  OF  THE  VARIATION  RATES  AND  DISPLAYS 


AMCRO  STUDY: 


Chest  Pain 


717  -  761-5085 


The  displays  that  follow  deal  with  percentages  of  variations  from 
established  critical  criteria  for  each  site  and  each  physician  or  health 
care  provider  group  within  the  site. 

Practice  Variation  Display  -  Definitions 

1.  Variation  -  A  variation  represents  a  patient  who  did  not  satisfy  the 
critical  criterion  during  the  initial  screen.    Variations  do  not 
necessarily  represent  deficiencies  in  patient  care.    The  practice 
physicians,  through  medical  record  review  and  analysis  may  explain 
(justify)  the  variations. 

2.  Variation  Rate  -  Percentage  of  patients  who  did  not  satisfy  the  critical 
criterion . 

3.  Project  Total  -  All  patients  from  all  sites  and  the  percentage  of  that 
total  who  varied  from  the  critical  criteria. 

4.  This  Practice  -    The  percentage  of  all  patients  in  the  study  from  the 
indicated  practice  site  who  varied  from  the  critical  criteria. 

5.  Provider  Display  -  The  percentage  of  patients  from  this  practice  site  wh 
varied  from  the  critical  criteria  and  the  identified  provider. 

6.  Identified  Provider  -  Health  care  provider  or  team  who  saw  the  patient 
most  during  the  study  period. 


1.  Variation  Distribution  -  The  range  (from  low  to  high)  of  percentages  of 
variations  among  the  ten  participating  practices. 

2.  Project  Total  -  All  patients  from  all  sites  and  the  percentage  of  that 
total  who  varied  from  the  critical  criteria. 
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.1.  PRACTICE  .VARIATION  DISPLAY-  CHEST  PAIN  STUDY 


SITE  # 


TOTAL  PTS  . '  IN*  STUDY"  -'483   PTS  . ,  THIS  SITE 


CRITERIA 


#  PTS', 


PROJECT 
TOTAL 


THIS 
PRACTICE 


±a 


Provider 
# 


Provider 
0 


Provider 


Provider 

#  • 


Provider 
'  9 


Provider 
I 


Provider 
# 


Provider 
# 


Provider 
# 


1.  Past  Medical  Hx 
Documented 


58< 


2.  Heart  Exam 
Recorded 


19% 


3.  Chest  Wall  or 
Lung  Exam  Noted 


12% 


4.  Blood  Pressure 
Recorded  


6% 


5.  Subsequent  Diag.or 
Follow  up  Noted 


21% 


NOTE;  FOR  DESCRIPTIONS  AND  DEFINITIONS  OF  THESE  DISPLAYS,  REFER  TO  PRECEDING  PAGE 


II.  VARIATION  DISTRIBUTION  -  CRITICAL  CRITERIA-  CHEST  PAIN  STUDY 

site  #    Total  Patients  in  Study    483.  Patients,  this  site. 


CRITERIA  • 

'  T?aMVTNrt  -  ALL  PRACTICE  SITES  -  LOWEST  TO  HIGHEST  VARIATION  RATES 

PROJECT 
TOTAL 

I 

II 

III' 

IV 

V 

VI 

VII 

VIII 

IX 

X 

1.  Past  Medical  Hx 
Documented 

38% 

41% 

42% 

46% 

48% 

66% 

67% 

'  74% 

85% 

100% 

58% 

2 .  Heart  Exam 
Recorded 

0% 

10% 

14% 

'  14%  ( 

16% 

21% 

24% 

29% 

32% 

47% 

19% 

3.  Chest  Wall  or  "< 
Lung  Exam  Noted 

0% 

5% 

8% 

9% 

9% 

10% 

14% 

16% 

37% 

42% 

12% 

4.  Elood  Pressure 
Recorded 

0% 

0% 

.-  0* 

4% 

5% 

5% 

5% 

5% 

12% 

24% 

6% 

5.  Subsequent  Diag. 
or  Follow-up  Noted 

5% 

9% 

14%- 

19% 

21*  

23% 

42% 

42% 

47% 

21% 
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SITE: 


AMCRO  DISPLAY  OF  ELEMENTS  OCCURRENCE 

STUDY:       Chest  Pain  Study  

Total  PTS :    Male  : 


Female : 


Code 

Element  of  Dare 

%  Pts  Proc. 
Occurred 

Frequency^ 

%  Pts  Non- 
occurrence 

%  Pts,» 
(X)  '  Time 

Per  100  Vis . 

I 

I  Per  Pt  Yr , 

UUj 

UXOO         J_  X  I*.     JD  •      i  • 

505 

EKG  Done 

.  — 

010 

Chest  X-Ray  Order 

 — 

510 

Chest  X-Ray  Done 



Did) 

Order    4  hour 
pp  Biood  Suqar 



517 

Results  4  hour 
pp  Blood  Sugar 

019 

Order  Blucose 
Tolerance  Test 

" 

Results  Glucose 
Tolerance  Test 



024 

Cholesterol  Order 



524 

Cholesterol  Done 

026 

Urinalysis  Order 

526 

Urinalysis  Done 

027 

CBC  Order 

527 

Hemoglobin  Done 



029 

Fasting  Blood 
Sugar  Order 

529 

Fasting  Blood 
Sugar  Done 

• 

030 

2  hr  Blood  Sugar 
Order 

520 

2  hr  Blood  Sugar 
Done 

031 

Random  Blood 
Sugar  Order 

531 

Random  Blood 
Sugar  Done 

049 

Heart  Exam 

053 

Family  History 

076 

Past  Medical  Hx 

077 

Chest  V7all  or 
Lung  Exam 

128 


SITE: 


AMCRO  DISPLAY  OF  ELEMENTS  OCCURRENCE 

STUDY:  Chest'  Pain  

Total  PTS:  Male: 


Female  j 


Code  I  Element  of  Care 


Pts  Proc. 
Occurred 


%  Pts.; 

> (X)  Time 


Frequency 


Per  100  Vis 


.  Per  Pt  Yr, 


%  Pts  Non- 
Occurrence 


078 


090 


History  of  Previous 
attack  Chest  Pain 


Screening  Panel  Ordei 


107 


Ataractics  or 
Tranquillizers 


108 


Sedatives 


113 


Skeletal 
Muscle  Relaxant 


114  I  Salycilates 


115  I  Analgesics 


116  I  Narcotics 


117  j  Phenyl  Butazone 

118  I  Indomethacin 


203  I  Subsequent  Diagnosis 


600 


Office  Visit 


650  J  Telephone  Call 


655      E.  R.  Visit 


675      House  Call 


*801  I  Medical  Consult  (W) 


811  I  Medical  Consult  (NO- 


802    Hospitalized  (W) 


812 


Hospitalized  (N) 


*  Documeni  ation  in  prepress  notes  <  i 


f  referral 


No  Docur  entation  in  progress  note  is  of  ref  erra  L 
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;;  JWCRO '  RANKING '  OP '  OCCURRENCE"  OF  ELEMENT  PISPLAV 
.       •  SITE  #   .: 


STUDY' 


Chpst  Pain 


TOTAL  PTS ,  IN  STUDY  '  483       PTS .  THIS  SITE 


Page  1, of  3 


00 
o 


This  display  deals  with  the"  range  (fro,  low  to^ighj  of  ^percentage SSS^teSSh 
for  whom  the  indicated  element  of  'care  occurred.    The  average  and  median  °|  ^  occurrcd  at 

element  is  displayed  for  comparison.  .  The  actual  percentage  of  .patents  for  v.hom  this  exc 


Element  of  Care/Code 

I 

II 

HE 

IV 

iw  to.. Hie 

V 

to  r 

VII 

T7TTT 

TV 

X 

Mean 

Systolic  B.  P. 

00 

95 

96 

96 

98 

98 

100 

100 

100 

96 

97 

Diastolic  B.  P.- 

86 

88 

95 

96 

96 

98 

98 

•  100 

100 

100 

96 

97 

EKG  Order 

32 

33 

41 

42 

49 

51 

52 

53 

60 

75 

49 

50 

EKG  Done 

26 

39 

47 

48 

58 

59 

61 

66 

6*7 

70 

-  54 

58.5 

Chest    X-Ray  Order 

17  ' 

18'  1 

29 

32 

33 

34 

37 

39 

48 

49 

34 

33.5 

Chest    X-Ray  Done 

8 

20 

20 

26 

'  30 

37 

40 

47 

54 

67 

35 

33.5 

Order  4  hour  pp 

u 

0 

0 

0 

0 

0 

0 

0 

5 

1 

0 

Blood  Sugar 
Results  4  hour  pp 
Blood  Sugar 

\j 

0 

0 

0 

0 

0 

0 

0 

0 

■  ! 

0 

0 

Order  Glucose 
Tolerance  Test 

0 

0 

0 

0 

0 

0 

0 

0 

1 

4 

1 

0 

Results  Glucose 
Tolerance  Test 

0 

0 

0 

0 

0  • 

0 

0 

0 

0 

2 

0 

0 

Cholesterol  Order 

0 

'  0 

p 

0 

0 

0 

1 

1 

2 

8 

1 

0 

cnoj.es tero j.  uone 

10 

16 

19 

19 

23 

23 

24 

32 

49 

58 

27 

23 

4 

5  • 

9 

10 

12 

16 

17 

20 

21 

23 

14 

14 

Urinalysis  Order 
Urinalysis  Done 

5 

20 

26 

29 

33 

36 

37 

37 

39 

50 

31  • 

34.5 

CBC  Order  

8.   '•  ' 

16 

20 

22 

22 

26 

27 

37 

38 

42 

26 

24 

Hemoglobin  Done 

17 

24 

26 

26 

32 

34 

37 

48 

53 

58 

36 

33 

FBS  Order 

•  0 

5 

5 

5 

6 

7 

1 

8 

8 

11 

19 

7 

6.5 

STUDY  Chest  Pain'        ■  •  ' 

wicpo  sassuss  asi  xjcrassAsB  I  os  aaaagsfoi  jsisg&sc  -site  #    page  2' 


I  1 

I  11 

iii 

row  m, 
IV 

V 

VI 

VII 

VIII 

•IX 

-X 

Mean 

Mod-! 

FES ' Results 

3 

5 

5 

5 

7 

7 

7 

8 

11 

51 

11 

1 

2  hr  Blood  Sugar  Ord 

0 

.  0 

■  0 

0 

0 

I 

2 

4 

5 

5 

2  . 

0.5 

2  hr  Blood  Sug.  Res. 

0 

0 

0 

.  .  0 

0 

0 

•  1 

2 

4 

5 

i  : 

0 

Random  B  S  Order 

0 

2 

3 

4 

4 

5 

8 

o 

10 

14 

6 

4.5 

Random  B  S  Results 

4  ' 

14 

17 

21  ■ 

.  22 

27 

29 

30 

32 

42 

24  ; 

24.5 

Heart  Exam 

63 

74 

76 

76 

85 

87 

88 

90 

93 

100 

83 

86 

Family  History 

5 

21 

22 

29 

34 

■  35 

46 

62 

65 

67 

'  39 

34.5 

Past  Medical  History 

0 

15 

26 

33 

34 

52 

53 

58 

59 

62 

39 

43 

Chest  Wall  -  Lung 
Examination 

74 

79 

84 

90 

92 

93 

94 

95 

100 

100 

90 

92.5 

Hx.  Previous 
Attack  Chest  Pain 

29 

41 

42 

52 

66 

'  71 

74 

78 

86 

100 

64 

68.5 

Screening  Panel  Ord. 

12 

.15 

15 

16 

24 

28 

33 

34 

37 

51 

27 

26 

Ataractics  or 
Trancruillizers 

.5  ' 

..16  '. 

22 

•'  •  25 

•  27 

27 

33 

37 

47  . 

66 

31 

27 

Sedatives 

0 

0  ' 

0 

2 

2 

8 

14 

 2  

 3-rS  

Skeletal 
Muscle  Relaxant 

0 

0 

■1 

1 

2 

2 

5 

5 

8 

15 

2 

Salycilates 

.8 

•  10 

12 

.15 

16 

16 

21 

23 

27 

38 

19 

16 

Analgesics 

0 

8' 

12 

18 

20 

21 

26 

26 

30 

32 

19 

20.5 

Narcotics 

0 

•  1 

2 

3 

5 

7 

7 

8 

10 

12  . 

6  . 

6 

Phenvl  Butazones 

'  0 

0 

0 

0 

0 

0 

1 

2 

2 

o 
z 

X 

0 

Indomethacln 

0 

0 

2. 

2 

2 

5 

6 

•7 

7 

11 

[ 

4 

3.5 

Subsequent  Diagnosis 

.  J3.: 

35 

58 

68 

68 

81 

j 

81      j     82       j  85 

.  90 

66 

75 

STUDY 


Chest  Pain 


Page  3 


lenient  nf  rr^n  and  Coda 


Office  Visit 


99 


II 


•HANK-JUG- 
III 


100 


100 


Ldm  Jba. 


iighl 


rv 


100 


V 


100 


100 


vii     1  via:  i 


IX 


Hear. 


100 


100 


100 


100 


100 


Telephone  Call 


11 


16 


28 


29 


45 


63 


24 


E.  R.  Visit 


11 


14 


House  Call 


★Medical  Consult  (W) 


14 


14 


18 


20 


21 


24 


25 


15 


Medical  Consult  (N) 


11 


16 


17 


Hospitalized  (W) 


15 


15 


1*3 


24 


Hospitalized  (N) 


14 


*  Docum  mtation 


in  progr 


sss  note 


;  of  referral  (W) 


No  Do 


rumentation  in  prsgress  n^tes  of  referral 


(N) 


( 
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